-- Logs begin at Fri 2022-09-23 14:14:44 UTC, end at Fri 2022-09-23 15:39:58 UTC. -- Sep 23 15:10:50.718767 dv-cinder-855307-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 23 15:10:50.729346 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 23 15:10:50.731423 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 23 15:10:50 2022] *** Sep 23 15:10:50.731423 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 23 15:10:50.731423 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 23 15:10:50.731423 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: nodename: dv-cinder-855307-2-iscsi Sep 23 15:10:50.731423 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: machine: x86_64 Sep 23 15:10:50.731423 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: clock source: unix Sep 23 15:10:50.731423 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: pcre jit disabled Sep 23 15:10:50.731423 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: detected number of CPU cores: 4 Sep 23 15:10:50.731423 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: current working directory: / Sep 23 15:10:50.731423 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: detected binary path: /usr/bin/uwsgi-core Sep 23 15:10:50.732229 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: your processes number limit is 47680 Sep 23 15:10:50.732229 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: your memory page size is 4096 bytes Sep 23 15:10:50.732229 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: detected max file descriptor number: 2048 Sep 23 15:10:50.732229 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: lock engine: pthread robust mutexes Sep 23 15:10:50.732229 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: thunder lock: enabled Sep 23 15:10:50.732229 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 23 15:10:50.732229 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 23 15:10:50.771715 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: Python main interpreter initialized at 0x55b1ddd459c0 Sep 23 15:10:50.771715 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: python threads support enabled Sep 23 15:10:50.771715 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: your server socket listen backlog is limited to 100 connections Sep 23 15:10:50.771715 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: your mercy for graceful operations on workers is 90 seconds Sep 23 15:10:50.772148 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: mapped 403077 bytes (393 KB) for 2 cores Sep 23 15:10:50.772238 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: *** Operational MODE: preforking *** Sep 23 15:10:50.772454 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: *** uWSGI is running in multiple interpreter mode *** Sep 23 15:10:50.772454 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: spawned uWSGI master process (pid: 106349) Sep 23 15:10:50.772669 dv-cinder-855307-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 23 15:10:50.776645 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: spawned uWSGI worker 1 (pid: 106350, cores: 1) Sep 23 15:10:50.776645 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: spawned uWSGI worker 2 (pid: 106351, cores: 1) Sep 23 15:10:50.776645 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 23 15:10:51.446386 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 23 15:10:51.471782 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 23 15:10:52.536822 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 15:10:52.536822 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: from cryptography.utils import int_from_bytes Sep 23 15:10:52.537448 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 15:10:52.537448 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: from cryptography.utils import int_from_bytes Sep 23 15:10:52.541856 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 15:10:52.541856 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: from cryptography.utils import int_from_bytes Sep 23 15:10:52.542664 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 15:10:52.542664 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: from cryptography.utils import int_from_bytes Sep 23 15:10:55.056931 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 15:10:55.057516 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 15:10:55.057715 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 15:10:55.058043 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 15:10:55.058293 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 15:10:55.058673 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.058993 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.059192 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 15:10:55.059568 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.059671 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 15:10:55.059760 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.059918 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.060059 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 15:10:55.060252 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.060400 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 15:10:55.060568 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.060670 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 15:10:55.060879 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.060979 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.061201 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.061299 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.061461 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.061549 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.061775 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.061883 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.064589 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855307-2-iscsi {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.064703 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.064794 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.064874 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.064942 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.065021 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.065095 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.065168 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.065235 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.065300 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.065371 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.065449 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.065517 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.065592 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.065672 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.065745 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855307-2-iscsi {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.065745 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.065891 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.066001 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.066074 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.066141 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.066206 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.066353 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.066424 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.066489 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.066554 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.066625 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.066711 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.066792 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.066867 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.066935 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.067012 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.067517 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.067626 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.067626 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.067779 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.067856 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.067923 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.068150 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.068254 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855307-2-iscsi {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.068467 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.068565 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.068780 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.068885 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.069100 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.069195 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.069416 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.069535 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.069732 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.069859 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.070049 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.070143 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.070396 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.070504 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855307-2-iscsi {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.070720 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.070827 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.071012 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.071138 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.071332 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.071433 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.071648 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.071734 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.071959 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.072088 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.072293 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.072378 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.072590 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.072674 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.072892 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.072986 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.073195 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.073281 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.073507 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.073598 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.073808 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.073895 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.074106 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.074190 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.074351 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.074480 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.074653 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.074782 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.074969 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.075090 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.075284 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.075400 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.075599 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.075722 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.075846 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.076047 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.076138 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.076354 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.076438 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.076607 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.076716 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.076917 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.077003 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.077241 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.077317 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.077562 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.077637 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.077871 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.077961 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.078122 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.078206 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.078371 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.078449 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.078692 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.078807 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.079545 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.079670 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.079856 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.079953 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.080192 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.080281 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.080503 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.080616 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.080810 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.080903 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.081119 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.081207 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.081427 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.081512 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.081732 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.081827 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.082037 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.082122 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.082356 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.082447 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.082670 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.082765 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.083374 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.083459 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.083548 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.083627 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.083714 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.083793 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.083876 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.083960 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.084202 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.084308 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.084506 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.084595 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.084820 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.084915 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.085155 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.085251 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.085456 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.085542 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.085704 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.085789 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.086001 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.086097 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.086300 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.086386 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.086610 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.086695 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.086911 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.087005 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.087212 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.087298 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.087512 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.087597 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.087805 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.087905 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.088121 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.088209 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.088419 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.088506 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.088718 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.088816 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.089022 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.089126 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.089320 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.089413 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.089621 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.089707 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.089918 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.090004 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.090214 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.090297 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.090579 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.090677 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.090804 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.090890 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.091106 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.091193 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.091412 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.091508 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.091710 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.091804 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.092034 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.092138 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.092338 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.092433 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.092641 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.092735 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.092948 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.093083 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.093245 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.093334 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.093545 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.093641 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.093858 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.093944 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.094156 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.094242 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.094454 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.094555 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.095336 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.095437 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.095639 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.095789 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.096029 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.096115 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.096262 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.096362 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.096557 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.096643 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.096857 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.096949 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.097167 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.097261 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.097466 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.097551 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.097763 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.097849 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.098061 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.098154 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.098356 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.098442 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.098651 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.098737 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.098948 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.099048 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.099243 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.099328 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.099538 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.099631 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.099829 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.099931 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.100165 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.100253 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.100478 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.100563 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.100781 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.100886 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.101079 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.101167 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.101378 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.101464 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.101677 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.101770 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.101981 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.102065 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.102280 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.102374 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.102600 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.102687 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.102924 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.103020 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.103233 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.103318 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.103539 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.103626 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.103842 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.103928 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.104183 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:10:55.104290 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.104497 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.104581 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.104821 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.104914 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.105131 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.105224 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.105440 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.105526 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.105749 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.105840 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.106063 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.106163 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.106377 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.106463 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.106703 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.106787 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.107016 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.107113 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.107326 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.107432 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.107641 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.107727 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.107945 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.108091 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.108279 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.108365 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.108599 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.108683 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.108915 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.109025 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.109222 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.109308 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.109547 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.109632 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.109865 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.109952 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.110179 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.110306 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.110517 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.110787 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.110884 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.111136 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.111230 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.111456 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.111542 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.111766 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.111861 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.112102 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.112192 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.112442 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.112529 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.112751 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.112921 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.113060 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.113146 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.113374 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.113455 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.113692 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.113871 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.114005 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.114134 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.114270 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.114417 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.114596 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.114691 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.114904 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.114980 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.115211 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.115286 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.115517 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.115661 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.115827 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.115913 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.116170 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.116255 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.116490 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.116577 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.116802 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.116888 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.117141 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.117244 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.117420 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.117506 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.117726 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.117810 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.118033 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.118132 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.118340 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.118432 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.118641 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.118728 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.118943 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.119038 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.119241 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.119326 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.119544 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.119630 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.119845 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.119940 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.120187 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.120276 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.120496 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.120581 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.120795 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.120893 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.121113 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.121209 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.121396 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.121490 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.121704 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.121798 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.122007 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.122092 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.122315 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.122399 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.122615 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.122701 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.122922 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.123007 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.123227 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.123312 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.123528 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.123663 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.123851 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.124036 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.124183 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.124319 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.124457 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.124575 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.124771 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.124862 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.125074 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.125170 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.125375 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.125463 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.125676 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.125761 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.126014 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.126108 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.126328 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.126528 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.126637 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.126850 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.126961 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.127160 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.127268 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.127482 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.127574 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.127793 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.127879 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.128133 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.128236 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.128467 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.128553 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.129086 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.129188 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.129188 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.129311 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.129400 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.129484 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.129708 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.129858 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.130022 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.130108 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.130318 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.130403 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.130623 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.130719 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.130925 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.131011 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.131225 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.131312 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.131524 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.131619 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.131828 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.131913 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.132150 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.132237 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.132454 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.132542 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.132751 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.132838 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.133050 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.133148 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.133345 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.133440 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.133661 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.133787 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.133969 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.134119 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.134264 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.134381 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.134547 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.134643 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.134845 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.134932 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.135144 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.135230 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.135465 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.135552 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.135828 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.135942 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.136093 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.136195 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.136397 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.136485 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.136700 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.136800 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.137044 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.137135 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.137353 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.137450 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.137657 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.137752 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.137967 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.138065 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.138275 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.138362 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.138583 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.138677 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.138899 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.138985 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.139207 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.139292 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.139514 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.139605 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.139817 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.139902 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.140149 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.140237 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.140455 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.140549 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.140770 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.140855 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.141070 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.141160 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.141379 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.141970 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.142207 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.142299 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.142771 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.142864 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.143096 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.143191 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.143415 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.143501 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.143722 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.143858 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.144076 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.144223 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.144403 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.144489 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.144712 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.144807 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.145019 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.145111 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.145327 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.145421 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.145642 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.145742 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.145949 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.146046 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.146254 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.146339 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.146557 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.146652 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.146866 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.146952 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.147169 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.147254 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.147482 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.147581 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.147777 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.147862 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.148107 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.148209 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.148428 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.148522 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.148752 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.148838 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.149058 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.149149 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.149368 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.149463 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.149667 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.149751 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.149978 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.150062 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.150282 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.150370 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.150589 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.150722 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.150891 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.150977 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.151192 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.151279 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.151496 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.151581 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.151807 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.151901 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.152134 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.152222 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.152439 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.152536 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.152746 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.152847 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.153050 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.153140 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.153353 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.153439 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.153651 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.153751 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.153951 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.154076 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.154257 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.154386 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.154563 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.154695 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.154867 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.154952 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.155172 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.155256 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.155476 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.155563 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.155773 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.155857 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.156099 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.156197 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.156415 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.156502 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.156713 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.156805 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.157013 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.157804 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.157913 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.157984 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.158165 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.158253 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.158481 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.158574 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.158795 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.158882 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.159094 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.159180 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.159397 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.159482 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.159701 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.159790 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.160021 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.160111 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.160334 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.160432 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.160640 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.160726 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.160943 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.161039 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.161256 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.161354 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.161562 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.161647 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.161867 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.161957 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.162174 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.162273 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.162481 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.162565 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.162788 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.162872 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.163094 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.163188 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.163410 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.163502 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.163708 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.163792 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.164033 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.164162 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.164341 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.164464 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.164639 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.164726 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.164946 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.165033 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.165254 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.165339 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.165561 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.165827 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.165922 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.166167 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.166321 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.166456 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.166573 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.166756 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.166853 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.167074 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.167171 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.167398 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.167646 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.167739 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.168027 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.168141 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.168323 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.168409 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.168643 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.168728 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.168946 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.169034 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.169248 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.169349 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.169547 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.169633 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.169851 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.169937 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.170151 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.170239 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.170453 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.170539 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.170753 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.170896 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.171056 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.171144 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.171354 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.171442 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.171653 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.171747 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.171951 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.172105 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.172273 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.172405 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.172587 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.172710 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.172941 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.173035 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.173251 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.173352 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.173551 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.173724 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.173868 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.174032 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.174171 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.174340 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.174524 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.174657 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.174743 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.174962 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.175047 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.175273 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.175373 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.175579 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.175665 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.175904 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.176021 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.176277 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.176386 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.176547 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.176636 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.176851 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.176937 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.177157 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.177244 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.177480 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.177567 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.177779 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.177915 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.178078 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.178170 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.178375 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.178469 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.178680 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.178766 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.178981 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.179076 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.179278 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.179372 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.179586 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.179722 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.179892 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.180011 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.180214 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.180314 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.180517 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.180612 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.180816 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.180902 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.181119 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.181203 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.181415 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.181511 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.181724 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.181809 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.182022 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.182106 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.182318 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.182412 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.182617 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.182711 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.182919 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.183005 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.183218 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.183312 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.183514 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.183607 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.183816 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.183902 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.184134 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.184224 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.184434 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.184510 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.184728 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.184804 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.185023 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.185110 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.185318 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.185403 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.185618 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.185701 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.185917 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.186003 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.186212 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.186298 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.186527 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.186623 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.186825 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.186912 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.187122 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.187208 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.187417 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.187511 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.187717 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.187803 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.188032 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.188122 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.188852 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.188961 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.189165 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.189258 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.189517 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.189624 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.189790 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.189886 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.190089 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.190176 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.190394 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.190481 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.190694 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.190789 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.190994 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.191079 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.191290 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.191382 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.191591 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.191685 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.191889 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.192004 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.192223 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.192315 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.192519 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.192606 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.192822 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.192951 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.193119 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.193206 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.193421 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.193507 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.193725 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.193809 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.194024 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.194109 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.194319 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.194417 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.194619 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.194694 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.194922 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.195083 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.195226 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.195313 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.195548 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.195634 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.195856 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.195950 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.196186 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.196273 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.196491 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.196633 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.196795 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.196895 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.197098 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.197197 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.197407 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.197492 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.197707 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.197802 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.198017 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.198104 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.198321 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.198412 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.198629 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.198723 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.198929 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.199022 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.199228 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.199314 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.199542 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.199629 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.199848 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.199935 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.200191 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.200280 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.200504 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.200599 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.200814 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.200899 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.201118 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.201209 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.201415 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.201508 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.201717 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.201803 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.202021 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.202114 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.202323 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.202410 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.202631 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.202717 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.202934 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.203068 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.203239 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.203326 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.203545 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.203638 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.203850 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.203995 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.204253 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.204418 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.204544 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.204633 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.204857 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.204957 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.205165 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.205261 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.205477 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.205570 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.205774 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.205871 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.206107 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.206199 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.206389 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.206482 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.206687 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.206775 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.206990 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.207081 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.207287 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.207371 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.207594 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.207681 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.207893 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.208010 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.208239 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.208361 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.208548 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.208670 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.208851 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.208979 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.209162 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.209278 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.209466 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.209585 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.209778 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.209892 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.210082 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.210204 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.210512 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.210597 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.210812 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.210897 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.211121 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.211265 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.211427 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.211514 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.211738 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.211824 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.212073 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.212183 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.212392 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.212479 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.212700 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.212785 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.213007 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.213108 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.213326 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.213412 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.213624 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.213720 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.213924 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.214011 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.214222 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.214317 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.214537 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.214623 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.214835 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.214922 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.215150 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.215276 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.215495 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.215580 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.215800 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.215887 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.216134 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.216224 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.216441 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.216549 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.216763 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.216897 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.217066 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.217153 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.217387 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.217483 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.217748 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.217833 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.218067 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.218153 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.218371 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.218468 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.218682 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.218783 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.218990 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.219077 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.219308 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.219402 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.220192 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.220303 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.220506 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.220632 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.220822 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.220950 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.221149 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.221287 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.221470 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.221562 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.221790 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.221877 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.222101 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.222197 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.222421 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.222507 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.222769 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.222855 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.223095 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.223183 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.223404 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.223498 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.223729 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.223816 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.224070 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.224160 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.224373 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.224459 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.224673 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.224771 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.224979 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.225079 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.225280 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.225422 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.225582 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.225696 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.225900 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.226019 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.226203 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.226346 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.226513 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.226653 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.226819 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.226957 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.227125 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.227268 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.227425 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.227573 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.227725 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.227879 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.228064 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.228232 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.228366 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.228539 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.228685 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.228852 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.228995 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.229164 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.229311 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.229473 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.229627 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.229780 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.229930 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.230087 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.230230 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.230409 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.230536 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.230714 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.230836 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.231038 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.231134 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.231353 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.231485 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.231676 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.231764 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.232018 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.232120 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.232329 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.232422 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.232652 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.232739 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.232972 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.233074 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.233273 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.233404 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.233575 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.233721 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.233880 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.233976 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.234212 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.234307 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.234518 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.234609 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.234828 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.234923 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.235147 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.235286 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.236048 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.236172 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.236360 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.236482 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.236696 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.236790 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.237027 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.237113 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.237349 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.237437 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.237661 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.237754 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.237966 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.238066 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.238267 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.238355 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.238569 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.238657 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.238870 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.238966 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.239183 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.239268 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.239481 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.239567 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.239785 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.239880 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.240120 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.240221 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.240423 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.240510 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.240724 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.240820 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.241025 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.241119 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.241329 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.241415 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.241652 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.241739 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.241955 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.242063 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.242267 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.242353 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.242579 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.242675 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.242885 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.242983 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.243193 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.243278 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.243496 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.243582 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.243806 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.243891 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.244145 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.244236 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.244459 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.244547 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.244772 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.244874 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.245076 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.245220 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.245387 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.245474 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.245695 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.245784 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.246009 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.246103 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.246325 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.246570 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.246657 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.246895 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.246984 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.247205 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.247293 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.247514 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.247600 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.247823 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.247917 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.248156 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.248245 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.248467 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.248568 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.248776 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.249029 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.249123 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.249358 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.249452 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.249666 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.249751 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.249978 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.250067 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.250293 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.250388 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.250608 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.250704 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.250953 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.251043 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.251267 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.251354 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.251580 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.251699 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.251889 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.252072 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.252236 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.252343 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.252565 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.252667 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.252889 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.252978 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.253220 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.253307 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.253555 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.253684 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.253870 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.253957 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.254183 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.254271 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.254490 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.254586 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.254801 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.254915 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.255108 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.255196 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.255417 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.255505 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.255724 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.255811 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.256052 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.256158 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.256365 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.256453 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.256678 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.256763 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.256992 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.257099 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.257306 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.257406 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.257622 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.257709 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.257931 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.258018 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.258240 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.258333 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.258549 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.258635 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.258862 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.259067 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.259178 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.259379 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.259502 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.259707 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.259837 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.260049 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.260183 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.260372 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.260499 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.260688 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.260814 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.261001 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.261131 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.261324 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.261625 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.261723 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.261927 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.262014 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.262236 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.262323 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.262549 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.262644 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.262850 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.262936 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.263167 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.263253 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.263475 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.263570 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.263775 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.263862 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.264114 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.264206 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.264421 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.264524 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.264730 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.264949 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.265051 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.265295 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.265395 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.265610 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.265710 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.265931 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.266016 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.266237 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.266333 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.266607 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.266703 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.266914 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.266990 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.267235 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.267788 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.267883 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.268124 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.268254 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.268440 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.268579 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.268749 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.268910 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.269049 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.269241 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.269351 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.269561 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.269648 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.269872 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.269960 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.270200 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.270287 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.270511 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.270599 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.270817 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.270903 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.271135 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.271220 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.271436 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.271531 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.271737 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.271833 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.272063 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.272154 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.272380 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.272469 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.272692 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.272778 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.273000 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.273109 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.273298 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.273385 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.273598 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.273685 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.273909 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.274006 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.274210 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.274310 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.274516 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.274601 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.274814 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.274908 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.275122 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.275209 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.275426 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.275555 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.275733 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.275834 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.276060 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.276149 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.276370 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.276468 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.276938 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.277039 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.277128 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.277208 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.277287 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.277365 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.277561 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.277649 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.277873 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.278024 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.278180 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.278274 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.278489 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.278585 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.278819 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.278905 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.279129 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.279221 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.279435 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.279654 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.279742 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.280031 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.280123 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.280326 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.280414 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.280655 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.280740 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.280972 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.281056 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.281271 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.281364 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.281572 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.281657 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.281871 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.281956 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.282725 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.283037 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.283123 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.283345 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.283439 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.283651 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.283739 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.283957 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.284132 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.284285 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.284395 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.284593 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.284709 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.284897 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.285019 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.285200 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.285329 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.285504 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.285656 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.285808 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.285970 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.286113 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.286284 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.286416 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.286597 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.286719 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.286910 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.287025 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.287222 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.287333 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.287533 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.287657 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.287846 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.287966 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.288183 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.288300 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.288496 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.288610 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.288807 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.288922 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.289119 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.289227 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.289429 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.289515 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.289739 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.289836 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.290053 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.290140 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.290369 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.290464 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.290711 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.290806 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.291017 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.291103 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.291317 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.291410 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.291641 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.291961 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.292067 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.292299 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.292385 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.292613 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.292712 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.292928 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.293015 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.293240 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.293326 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.293556 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.293650 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.293872 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.293966 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.294181 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.294279 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.294485 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.294579 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.294792 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.295118 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.295211 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.295452 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.295548 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.295776 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.295862 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.296125 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.296217 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.296428 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.296527 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.296730 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.296817 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.297029 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.297116 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.297333 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.297429 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.297646 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.298342 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.298510 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.298607 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.298845 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.298933 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.299178 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.299293 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.299487 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.299630 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.299788 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.299960 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.300115 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.300292 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.300417 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.300603 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.300720 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.300910 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.301025 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.301222 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.301315 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.301545 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.301645 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.301857 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.301944 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.302163 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.302249 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.302460 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.302553 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.302757 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.302845 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.303062 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.303148 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.303357 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.303444 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.303657 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.303752 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.303955 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.304081 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.304276 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.304372 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.304575 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.304662 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.304878 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.304964 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.305185 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.305282 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.305490 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.305577 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.305795 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.305890 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.306101 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.306188 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.306414 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.306500 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.306719 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.306853 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.307071 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.307165 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.307328 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.307417 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.307632 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.307728 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.307935 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.308043 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.308285 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.308373 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.308592 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.308690 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.308901 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.308988 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.309210 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.309297 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.309516 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.309619 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.309821 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.309908 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.310126 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.310213 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.310448 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.310535 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.310764 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.310851 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.311068 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.311154 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.311379 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.311472 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.311690 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.311777 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.312025 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.312129 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.312340 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.312426 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.312644 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.312729 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.312980 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.313080 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.313264 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.313383 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.313594 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.313680 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.313901 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.314108 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.314196 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.314442 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.314530 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.314751 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.314846 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.315078 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.315164 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.315384 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.315476 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.315697 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.315792 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.316030 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.316118 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.316347 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.316433 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.316673 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.316770 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.316980 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.317067 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.317289 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.317374 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.317602 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.317697 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.317914 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.318000 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.318223 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.318309 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.318538 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.318634 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.318849 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.318936 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.319158 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.319243 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.319466 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.319560 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.319769 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.319856 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.320028 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 15:10:55.320119 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.320440 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.320751 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.321077 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.321408 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.321758 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.322072 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.322418 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.322744 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.323057 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.323369 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.323683 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:10:55.323928 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 15:10:55.472706 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO dbcounter [None req-c3fa6409-bdc2-4fd2-8156-65793564cd0a None None] Registered counter for database nova_api Sep 23 15:10:55.476606 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO dbcounter [None req-bf7ec072-60f5-4f45-bf6b-31bfa4d9f27b None None] Registered counter for database nova_api Sep 23 15:10:55.493723 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_db.sqlalchemy.engines [None req-c3fa6409-bdc2-4fd2-8156-65793564cd0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:10:55.496653 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG oslo_db.sqlalchemy.engines [None req-bf7ec072-60f5-4f45-bf6b-31bfa4d9f27b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:10:55.500300 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG dbcounter [-] [106350] Writer thread running {{(pid=106350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:10:55.503173 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG dbcounter [-] [106351] Writer thread running {{(pid=106351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:10:55.556305 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.context [None req-c3fa6409-bdc2-4fd2-8156-65793564cd0a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4716d4cc-8887-47c1-8c33-3edcb99d9da0(cell1) {{(pid=106350) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 15:10:55.559245 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.context [None req-bf7ec072-60f5-4f45-bf6b-31bfa4d9f27b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4716d4cc-8887-47c1-8c33-3edcb99d9da0(cell1) {{(pid=106351) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 15:10:55.560190 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-c3fa6409-bdc2-4fd2-8156-65793564cd0a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:10:55.560658 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-c3fa6409-bdc2-4fd2-8156-65793564cd0a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:10:55.562179 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-c3fa6409-bdc2-4fd2-8156-65793564cd0a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:10:55.562899 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-c3fa6409-bdc2-4fd2-8156-65793564cd0a None None] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:10:55.563031 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG oslo_concurrency.lockutils [None req-bf7ec072-60f5-4f45-bf6b-31bfa4d9f27b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:10:55.563351 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-c3fa6409-bdc2-4fd2-8156-65793564cd0a None None] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:10:55.563530 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG oslo_concurrency.lockutils [None req-bf7ec072-60f5-4f45-bf6b-31bfa4d9f27b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:10:55.565123 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG oslo_concurrency.lockutils [None req-bf7ec072-60f5-4f45-bf6b-31bfa4d9f27b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:10:55.565433 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-c3fa6409-bdc2-4fd2-8156-65793564cd0a None None] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:10:55.565847 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG oslo_concurrency.lockutils [None req-bf7ec072-60f5-4f45-bf6b-31bfa4d9f27b None None] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:10:55.566294 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG oslo_concurrency.lockutils [None req-bf7ec072-60f5-4f45-bf6b-31bfa4d9f27b None None] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:10:55.567397 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO dbcounter [None req-c3fa6409-bdc2-4fd2-8156-65793564cd0a None None] Registered counter for database nova_cell0 Sep 23 15:10:55.568305 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG oslo_concurrency.lockutils [None req-bf7ec072-60f5-4f45-bf6b-31bfa4d9f27b None None] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:10:55.570276 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO dbcounter [None req-bf7ec072-60f5-4f45-bf6b-31bfa4d9f27b None None] Registered counter for database nova_cell0 Sep 23 15:10:55.571406 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO dbcounter [None req-c3fa6409-bdc2-4fd2-8156-65793564cd0a None None] Registered counter for database nova_cell1 Sep 23 15:10:55.574277 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO dbcounter [None req-bf7ec072-60f5-4f45-bf6b-31bfa4d9f27b None None] Registered counter for database nova_cell1 Sep 23 15:10:55.578589 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_db.sqlalchemy.engines [None req-c3fa6409-bdc2-4fd2-8156-65793564cd0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:10:55.581001 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_db.sqlalchemy.engines [None req-c3fa6409-bdc2-4fd2-8156-65793564cd0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:10:55.583265 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG oslo_db.sqlalchemy.engines [None req-bf7ec072-60f5-4f45-bf6b-31bfa4d9f27b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:10:55.585220 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG oslo_db.sqlalchemy.engines [None req-bf7ec072-60f5-4f45-bf6b-31bfa4d9f27b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:10:55.586887 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG dbcounter [-] [106350] Writer thread running {{(pid=106350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:10:55.589080 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG dbcounter [-] [106350] Writer thread running {{(pid=106350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:10:55.590691 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG dbcounter [-] [106351] Writer thread running {{(pid=106351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:10:55.593557 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG dbcounter [-] [106351] Writer thread running {{(pid=106351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:10:55.734140 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO dbcounter [None req-c3fa6409-bdc2-4fd2-8156-65793564cd0a None None] Registered counter for database nova_cell0 Sep 23 15:10:55.740791 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO dbcounter [None req-bf7ec072-60f5-4f45-bf6b-31bfa4d9f27b None None] Registered counter for database nova_cell0 Sep 23 15:10:55.743517 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_db.sqlalchemy.engines [None req-c3fa6409-bdc2-4fd2-8156-65793564cd0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:10:55.748116 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG dbcounter [-] [106350] Writer thread running {{(pid=106350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:10:55.749350 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG oslo_db.sqlalchemy.engines [None req-bf7ec072-60f5-4f45-bf6b-31bfa4d9f27b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:10:55.754066 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG dbcounter [-] [106351] Writer thread running {{(pid=106351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:10:56.144703 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: WARNING keystonemiddleware.auth_token [None req-c3fa6409-bdc2-4fd2-8156-65793564cd0a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 15:10:56.151912 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: WARNING keystonemiddleware.auth_token [None req-c3fa6409-bdc2-4fd2-8156-65793564cd0a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 15:10:56.171803 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: WARNING keystonemiddleware.auth_token [None req-bf7ec072-60f5-4f45-bf6b-31bfa4d9f27b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 15:10:56.180089 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: WARNING keystonemiddleware.auth_token [None req-bf7ec072-60f5-4f45-bf6b-31bfa4d9f27b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 15:10:56.496376 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: WARNING keystonemiddleware.auth_token [None req-c3fa6409-bdc2-4fd2-8156-65793564cd0a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 15:10:56.502464 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: WARNING keystonemiddleware.auth_token [None req-c3fa6409-bdc2-4fd2-8156-65793564cd0a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 15:10:56.507729 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b1ddd459c0 pid: 106350 (default app) Sep 23 15:10:56.509793 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-c3fa6409-bdc2-4fd2-8156-65793564cd0a None None] Calling method '>' {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:10:56.510967 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-c3fa6409-bdc2-4fd2-8156-65793564cd0a None None] 10.222.0.55 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001706 Sep 23 15:10:56.511374 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 788 bytes} [Fri Sep 23 15:10:56 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:10:56.539384 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: WARNING keystonemiddleware.auth_token [None req-bf7ec072-60f5-4f45-bf6b-31bfa4d9f27b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 15:10:56.545378 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: WARNING keystonemiddleware.auth_token [None req-bf7ec072-60f5-4f45-bf6b-31bfa4d9f27b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 15:10:56.551140 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b1ddd459c0 pid: 106351 (default app) Sep 23 15:12:24.302978 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-c3fa6409-bdc2-4fd2-8156-65793564cd0a None None] Calling method '>' {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:12:24.304424 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-c3fa6409-bdc2-4fd2-8156-65793564cd0a None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001963 Sep 23 15:12:24.304974 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 2/2] 10.222.0.55 () {54 vars in 931 bytes} [Fri Sep 23 15:12:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:12:24.323031 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG dbcounter [-] [106351] Writing DB stats nova_api:SELECT=3 {{(pid=106351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:12:24.330053 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG dbcounter [-] [106351] Writing DB stats nova_cell0:SELECT=3 {{(pid=106351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:12:24.330053 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG dbcounter [-] [106351] Writing DB stats nova_cell1:SELECT=3 {{(pid=106351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:12:24.330053 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG dbcounter [-] [106351] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:12:25.574501 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-e73d477e-a17f-436b-99e9-46b204e06aba admin admin] Calling method '>' {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:12:25.619318 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-e73d477e-a17f-436b-99e9-46b204e06aba admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.304105 Sep 23 15:12:25.620475 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 1/3] 10.222.0.55 () {60 vars in 1292 bytes} [Fri Sep 23 15:12:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:12:28.697155 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-c3fa6409-bdc2-4fd2-8156-65793564cd0a None None] Calling method '>' {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:12:28.698163 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-c3fa6409-bdc2-4fd2-8156-65793564cd0a None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Sep 23 15:12:28.698551 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 3/4] 10.222.0.55 () {54 vars in 931 bytes} [Fri Sep 23 15:12:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:12:29.223034 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-f70cc4cb-b015-4012-a5fb-47616e2c8644 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "c1"}} {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:12:29.369668 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-f70cc4cb-b015-4012-a5fb-47616e2c8644 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.664140 Sep 23 15:12:29.370494 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 2/5] 10.222.0.55 () {64 vars in 1283 bytes} [Fri Sep 23 15:12:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 15:12:29.386799 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG dbcounter [-] [106350] Writing DB stats nova_api:SELECT=3 {{(pid=106350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:12:29.388031 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG dbcounter [-] [106350] Writing DB stats nova_cell1:SELECT=3 {{(pid=106350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:12:29.390072 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG dbcounter [-] [106350] Writing DB stats nova_cell0:SELECT=3 {{(pid=106350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:12:29.391591 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG dbcounter [-] [106350] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:12:29.620462 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-4bdea28b-5f6f-4d8a-946c-a5a28a290243 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:12:29.782860 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-4bdea28b-5f6f-4d8a-946c-a5a28a290243 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.401544 Sep 23 15:12:29.796079 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 4/6] 10.222.0.55 () {64 vars in 1336 bytes} [Fri Sep 23 15:12:29 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:12:32.732115 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-f70cc4cb-b015-4012-a5fb-47616e2c8644 admin admin] Calling method '>' {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:12:32.734626 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-f70cc4cb-b015-4012-a5fb-47616e2c8644 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002777 Sep 23 15:12:32.735906 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 3/7] 10.222.0.55 () {54 vars in 931 bytes} [Fri Sep 23 15:12:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:12:33.481768 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-255f42d8-4771-42d5-babb-bb106b1793f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "ram": 512, "name": "ds512M", "id": "d1"}} {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:12:33.605658 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-255f42d8-4771-42d5-babb-bb106b1793f1 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.857636 Sep 23 15:12:33.605658 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 5/8] 10.222.0.55 () {64 vars in 1283 bytes} [Fri Sep 23 15:12:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:12:33.622750 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-21949c71-2a34-49cb-b095-95d1fa310fe0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:12:33.772925 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-21949c71-2a34-49cb-b095-95d1fa310fe0 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.155907 Sep 23 15:12:33.773485 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 4/9] 10.222.0.55 () {64 vars in 1336 bytes} [Fri Sep 23 15:12:33 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:12:36.678011 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-255f42d8-4771-42d5-babb-bb106b1793f1 admin admin] Calling method '>' {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:12:36.678011 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-255f42d8-4771-42d5-babb-bb106b1793f1 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 23 15:12:36.678011 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 6/10] 10.222.0.55 () {54 vars in 931 bytes} [Fri Sep 23 15:12:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:12:37.150807 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-704311c4-b5d2-4f36-b031-91d5814ff13d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 10, "ram": 1024, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "id": "d2", "rxtx_factor": 1.0}} {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:12:37.234425 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-704311c4-b5d2-4f36-b031-91d5814ff13d admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.559254 Sep 23 15:12:37.235027 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 5/11] 10.222.0.55 () {64 vars in 1283 bytes} [Fri Sep 23 15:12:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:12:37.247035 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-7f1934ac-347f-47d8-85a6-2c2bb7718f16 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:12:37.324747 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-7f1934ac-347f-47d8-85a6-2c2bb7718f16 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081236 Sep 23 15:12:37.325243 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 7/12] 10.222.0.55 () {64 vars in 1336 bytes} [Fri Sep 23 15:12:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:12:40.037643 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-704311c4-b5d2-4f36-b031-91d5814ff13d admin admin] Calling method '>' {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:12:40.038317 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-704311c4-b5d2-4f36-b031-91d5814ff13d admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Sep 23 15:12:40.051178 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 6/13] 10.222.0.55 () {54 vars in 931 bytes} [Fri Sep 23 15:12:40 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:12:40.477813 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-f0ab9803-babd-440c-bb6d-4f8cbf38ebe1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "os-flavor-access:is_public": true, "vcpus": 2, "disk": 10, "rxtx_factor": 1.0, "swap": 0}} {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:12:40.565886 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-f0ab9803-babd-440c-bb6d-4f8cbf38ebe1 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.521305 Sep 23 15:12:40.566514 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 8/14] 10.222.0.55 () {64 vars in 1283 bytes} [Fri Sep 23 15:12:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:12:40.578512 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-93483ce4-c8d1-44dc-a88e-4dbb34cda52a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:12:40.678437 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-93483ce4-c8d1-44dc-a88e-4dbb34cda52a admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103261 Sep 23 15:12:40.684403 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 7/15] 10.222.0.55 () {64 vars in 1336 bytes} [Fri Sep 23 15:12:40 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:12:43.658385 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-f0ab9803-babd-440c-bb6d-4f8cbf38ebe1 admin admin] Calling method '>' {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:12:43.659360 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-f0ab9803-babd-440c-bb6d-4f8cbf38ebe1 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 23 15:12:43.659715 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 9/16] 10.222.0.55 () {54 vars in 931 bytes} [Fri Sep 23 15:12:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:12:44.104740 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-f28fc49b-3636-4a53-80f1-6fe87513ba99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "d4", "vcpus": 4, "disk": 20}} {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:12:44.179914 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-f28fc49b-3636-4a53-80f1-6fe87513ba99 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.513548 Sep 23 15:12:44.180725 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 8/17] 10.222.0.55 () {64 vars in 1283 bytes} [Fri Sep 23 15:12:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:12:44.196076 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-500d265c-28a6-4afb-9762-217d106071c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:12:44.319784 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-500d265c-28a6-4afb-9762-217d106071c4 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.128261 Sep 23 15:12:44.320413 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 10/18] 10.222.0.55 () {64 vars in 1336 bytes} [Fri Sep 23 15:12:44 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:12:47.034196 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-f28fc49b-3636-4a53-80f1-6fe87513ba99 admin admin] Calling method '>' {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:12:47.035172 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-f28fc49b-3636-4a53-80f1-6fe87513ba99 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Sep 23 15:12:47.035606 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 9/19] 10.222.0.55 () {54 vars in 931 bytes} [Fri Sep 23 15:12:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:12:47.530359 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-b88faa43-88a2-49a3-8c69-3a18470a861b admin admin] Calling method '>' {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:12:47.556880 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-b88faa43-88a2-49a3-8c69-3a18470a861b admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.514696 Sep 23 15:12:47.557451 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 11/20] 10.222.0.55 () {60 vars in 1292 bytes} [Fri Sep 23 15:12:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:12:50.230859 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-f28fc49b-3636-4a53-80f1-6fe87513ba99 admin admin] Calling method '>' {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:12:50.231898 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-f28fc49b-3636-4a53-80f1-6fe87513ba99 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Sep 23 15:12:50.232366 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 10/21] 10.222.0.55 () {54 vars in 931 bytes} [Fri Sep 23 15:12:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:12:50.668138 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-f55f43cd-b5a0-4fdf-bc2c-5a41e622eeab admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "m1.tiny", "ram": 512, "disk": 1, "vcpus": 1}} {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:12:50.755504 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-f55f43cd-b5a0-4fdf-bc2c-5a41e622eeab admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.515645 Sep 23 15:12:50.756104 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 12/22] 10.222.0.55 () {64 vars in 1283 bytes} [Fri Sep 23 15:12:50 2022] POST /compute/v2.1/flavors => generated 402 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:12:50.769605 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-f8a4d5ac-e257-4c9a-bbca-cd0b6a486fc7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:12:50.883276 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-f8a4d5ac-e257-4c9a-bbca-cd0b6a486fc7 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118592 Sep 23 15:12:50.883862 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 11/23] 10.222.0.55 () {64 vars in 1333 bytes} [Fri Sep 23 15:12:50 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:12:53.625057 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-f55f43cd-b5a0-4fdf-bc2c-5a41e622eeab admin admin] Calling method '>' {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:12:53.626970 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-f55f43cd-b5a0-4fdf-bc2c-5a41e622eeab admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002581 Sep 23 15:12:53.627646 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 13/24] 10.222.0.55 () {54 vars in 931 bytes} [Fri Sep 23 15:12:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:12:54.127596 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-d88f3247-2848-4142-97b3-d873bdb204b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "2", "name": "m1.small", "vcpus": 1, "disk": 20, "swap": 0, "ram": 2048}} {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:12:54.212117 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-d88f3247-2848-4142-97b3-d873bdb204b0 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.577632 Sep 23 15:12:54.213350 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 12/25] 10.222.0.55 () {64 vars in 1283 bytes} [Fri Sep 23 15:12:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:12:54.225970 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-0d7288a6-a1b7-4256-8597-864d250a9e74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:12:55.106115 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-0d7288a6-a1b7-4256-8597-864d250a9e74 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.883771 Sep 23 15:12:55.116923 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 14/26] 10.222.0.55 () {64 vars in 1333 bytes} [Fri Sep 23 15:12:54 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:12:57.886527 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-d88f3247-2848-4142-97b3-d873bdb204b0 admin admin] Calling method '>' {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:12:57.887639 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-d88f3247-2848-4142-97b3-d873bdb204b0 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Sep 23 15:12:57.888086 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 13/27] 10.222.0.55 () {54 vars in 931 bytes} [Fri Sep 23 15:12:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:12:58.392046 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-816b74fd-b32a-48bc-9253-537306fd20e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "disk": 40, "name": "m1.medium", "id": "3"}} {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:12:58.463674 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-816b74fd-b32a-48bc-9253-537306fd20e4 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.568696 Sep 23 15:12:58.464270 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 15/28] 10.222.0.55 () {64 vars in 1283 bytes} [Fri Sep 23 15:12:57 2022] POST /compute/v2.1/flavors => generated 406 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:12:58.480694 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-ff61515e-38ce-42ad-a0df-9ded03a84b0d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:12:58.485988 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG dbcounter [-] [106351] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:12:58.535124 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-ff61515e-38ce-42ad-a0df-9ded03a84b0d admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.061963 Sep 23 15:12:58.535897 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 14/29] 10.222.0.55 () {64 vars in 1333 bytes} [Fri Sep 23 15:12:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:13:01.415456 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-816b74fd-b32a-48bc-9253-537306fd20e4 admin admin] Calling method '>' {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:13:01.416398 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-816b74fd-b32a-48bc-9253-537306fd20e4 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 Sep 23 15:13:01.416788 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 16/30] 10.222.0.55 () {54 vars in 931 bytes} [Fri Sep 23 15:13:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:13:01.898476 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-b7c58f89-adc1-46f7-8e0f-137513f23e4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "name": "m1.large", "ram": 8192, "id": "4", "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:13:01.982928 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-b7c58f89-adc1-46f7-8e0f-137513f23e4d admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.558501 Sep 23 15:13:01.984395 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 15/31] 10.222.0.55 () {64 vars in 1283 bytes} [Fri Sep 23 15:13:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:13:01.997493 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-9514c18f-42cb-48c9-89c4-d007dbbb84b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:13:02.078725 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-9514c18f-42cb-48c9-89c4-d007dbbb84b2 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085201 Sep 23 15:13:02.079716 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 17/32] 10.222.0.55 () {64 vars in 1333 bytes} [Fri Sep 23 15:13:01 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:13:04.836893 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-b7c58f89-adc1-46f7-8e0f-137513f23e4d admin admin] Calling method '>' {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:13:04.838055 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-b7c58f89-adc1-46f7-8e0f-137513f23e4d admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 23 15:13:04.840615 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 16/33] 10.222.0.55 () {54 vars in 931 bytes} [Fri Sep 23 15:13:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:13:05.367679 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-a1c42501-494e-4f68-bf02-bdaddbd5faab admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "name": "m1.xlarge", "swap": 0, "rxtx_factor": 1.0, "id": "5", "disk": 160, "os-flavor-access:is_public": true, "vcpus": 8}} {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:13:05.375597 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG dbcounter [-] [106350] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:05.664391 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-a1c42501-494e-4f68-bf02-bdaddbd5faab admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.789553 Sep 23 15:13:05.664391 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 18/34] 10.222.0.55 () {64 vars in 1283 bytes} [Fri Sep 23 15:13:04 2022] POST /compute/v2.1/flavors => generated 408 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:13:05.664601 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-543b9111-c057-471d-8f6c-cd7471c8ae11 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:13:06.495182 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-543b9111-c057-471d-8f6c-cd7471c8ae11 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.849976 Sep 23 15:13:06.500014 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 17/35] 10.222.0.55 () {64 vars in 1333 bytes} [Fri Sep 23 15:13:05 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:13:21.144006 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-a1c42501-494e-4f68-bf02-bdaddbd5faab admin admin] Calling method '>' {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:13:21.145019 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-a1c42501-494e-4f68-bf02-bdaddbd5faab admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 23 15:13:21.145440 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 19/36] 10.222.0.55 () {54 vars in 931 bytes} [Fri Sep 23 15:13:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:13:21.155882 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG dbcounter [-] [106351] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:21.552458 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-aa5bbb07-f418-4a3f-9725-74aeb1034ac7 admin admin] Calling method '>' {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:13:21.572852 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-aa5bbb07-f418-4a3f-9725-74aeb1034ac7 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.421351 Sep 23 15:13:21.573397 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 18/37] 10.222.0.55 () {60 vars in 1292 bytes} [Fri Sep 23 15:13:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:13:22.906644 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-a1c42501-494e-4f68-bf02-bdaddbd5faab admin admin] Calling method '>' {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:13:22.907628 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-a1c42501-494e-4f68-bf02-bdaddbd5faab admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Sep 23 15:13:22.908034 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 20/38] 10.222.0.55 () {56 vars in 1074 bytes} [Fri Sep 23 15:13:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:13:23.445462 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-916c8931-db78-4449-931b-024e7b3aa456 admin admin] Calling method '>' {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:13:23.450753 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.wsgi [None req-916c8931-db78-4449-931b-024e7b3aa456 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 23 15:13:23.454098 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-916c8931-db78-4449-931b-024e7b3aa456 admin admin] Request method failure captured: Sep 23 15:13:23.454098 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 23 15:13:23.454098 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: Accept: application/json Sep 23 15:13:23.454098 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: Accept-Encoding: gzip, deflate Sep 23 15:13:23.454098 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: Connection: keep-alive Sep 23 15:13:23.454098 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: Content-Length: 0 Sep 23 15:13:23.454098 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: Host: 10.222.0.55 Sep 23 15:13:23.454098 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: Openstack-Api-Version: compute 2.92 Sep 23 15:13:23.454098 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: Openstack-System-Scope: None Sep 23 15:13:23.454098 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: User-Agent: python-novaclient Sep 23 15:13:23.454098 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Auth-Token: gAAAAABjLc0SMN56whuEy83AUzh0V8KlnCqj9_tZWGROt_YuQ-OKM0lAXnkCxKKDceN4qtYwQqaWD4Y6OZGumT7ptUGTMZv4Id1dJqyToaciL1keASdphKghrbbOq7SBkwllLKpqupTnzaCzyzvqHqimxcjMKbTt01MfW2-pFqpwHdpRFJSUNgY Sep 23 15:13:23.454098 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Domain-Id: None Sep 23 15:13:23.454098 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Domain-Name: None Sep 23 15:13:23.454098 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Identity-Status: Confirmed Sep 23 15:13:23.454098 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Is-Admin-Project: True Sep 23 15:13:23.454098 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 15:13:23.454098 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Project-Domain-Id: default Sep 23 15:13:23.454098 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Project-Domain-Name: Default Sep 23 15:13:23.454098 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Project-Id: 23b5c58d198d4456bfeec0a8daae1113 Sep 23 15:13:23.454098 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Project-Name: admin Sep 23 15:13:23.454098 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Role: reader,member,admin Sep 23 15:13:23.454098 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Roles: reader,member,admin Sep 23 15:13:23.455706 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/23b5c58d198d4456bfeec0a8daae1113"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/23b5c58d198d4456bfeec0a8daae1113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_23b5c58d198d4456bfeec0a8daae1113", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/23b5c58d198d4456bfeec0a8daae1113"}]}] Sep 23 15:13:23.455706 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Tenant: admin Sep 23 15:13:23.455706 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Tenant-Id: 23b5c58d198d4456bfeec0a8daae1113 Sep 23 15:13:23.455706 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Tenant-Name: admin Sep 23 15:13:23.455706 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-User: admin Sep 23 15:13:23.455706 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-User-Domain-Id: default Sep 23 15:13:23.455706 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-User-Domain-Name: Default Sep 23 15:13:23.455706 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-User-Id: 0fc10e0211a54a0faf7ea9b86542de03 Sep 23 15:13:23.455706 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-User-Name: admin Sep 23 15:13:23.455706 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: method: > Sep 23 15:13:23.455706 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: exception: Flavor 42 could not be found. Sep 23 15:13:23.455706 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: action_args: {'id': '42'} Sep 23 15:13:23.455706 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:13:23.455706 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:13:23.456812 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 15:13:23.456812 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 15:13:23.456812 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 15:13:23.456812 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 15:13:23.456812 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 15:13:23.456812 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 15:13:23.456812 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 15:13:23.456812 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 15:13:23.456812 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 15:13:23.456812 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:13:23.456812 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 15:13:23.456812 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 15:13:23.456812 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 23 15:13:23.456812 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi Sep 23 15:13:23.456812 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:13:23.456812 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi Sep 23 15:13:23.456812 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:13:23.456812 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:13:23.456812 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:13:23.458319 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:13:23.458319 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:13:23.458319 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:13:23.458319 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:13:23.458319 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 15:13:23.458319 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:13:23.458319 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 23 15:13:23.458319 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi Sep 23 15:13:23.458319 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:13:23.458319 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi Sep 23 15:13:23.458319 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:13:23.458319 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:13:23.458319 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:13:23.458319 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:13:23.458319 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:13:23.458319 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 23 15:13:23.458319 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi Sep 23 15:13:23.458319 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-916c8931-db78-4449-931b-024e7b3aa456 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:13:23.459575 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-916c8931-db78-4449-931b-024e7b3aa456 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.398737 Sep 23 15:13:23.459575 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 19/39] 10.222.0.55 () {60 vars in 1190 bytes} [Fri Sep 23 15:13:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 15:13:23.465202 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-83b9f563-1648-4e3d-8671-2439abc692e7 admin admin] Calling method '>' {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:13:23.488893 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-83b9f563-1648-4e3d-8671-2439abc692e7 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027167 Sep 23 15:13:23.489453 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 21/40] 10.222.0.55 () {60 vars in 1210 bytes} [Fri Sep 23 15:13:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:13:23.500263 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-86c3c40f-5c56-49c3-acbd-cca83c022ceb admin admin] Calling method '>' {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:13:23.521818 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-86c3c40f-5c56-49c3-acbd-cca83c022ceb admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026021 Sep 23 15:13:23.522363 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 20/41] 10.222.0.55 () {60 vars in 1210 bytes} [Fri Sep 23 15:13:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:13:23.532627 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-b563899a-0f4e-4715-b1f8-4f6c2b665abf admin admin] Calling method '>' {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:13:23.538031 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.wsgi [None req-b563899a-0f4e-4715-b1f8-4f6c2b665abf admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 23 15:13:23.541241 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-b563899a-0f4e-4715-b1f8-4f6c2b665abf admin admin] Request method failure captured: Sep 23 15:13:23.541241 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 23 15:13:23.541241 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: Accept: application/json Sep 23 15:13:23.541241 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: Accept-Encoding: gzip, deflate Sep 23 15:13:23.541241 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: Connection: keep-alive Sep 23 15:13:23.541241 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: Content-Length: 0 Sep 23 15:13:23.541241 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: Host: 10.222.0.55 Sep 23 15:13:23.541241 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: Openstack-Api-Version: compute 2.92 Sep 23 15:13:23.541241 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: Openstack-System-Scope: None Sep 23 15:13:23.541241 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: User-Agent: python-novaclient Sep 23 15:13:23.541241 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Auth-Token: gAAAAABjLc0SMN56whuEy83AUzh0V8KlnCqj9_tZWGROt_YuQ-OKM0lAXnkCxKKDceN4qtYwQqaWD4Y6OZGumT7ptUGTMZv4Id1dJqyToaciL1keASdphKghrbbOq7SBkwllLKpqupTnzaCzyzvqHqimxcjMKbTt01MfW2-pFqpwHdpRFJSUNgY Sep 23 15:13:23.541241 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Domain-Id: None Sep 23 15:13:23.541241 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Domain-Name: None Sep 23 15:13:23.541241 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Identity-Status: Confirmed Sep 23 15:13:23.541241 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Is-Admin-Project: True Sep 23 15:13:23.541241 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 15:13:23.541241 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Project-Domain-Id: default Sep 23 15:13:23.541241 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Project-Domain-Name: Default Sep 23 15:13:23.541241 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Project-Id: 23b5c58d198d4456bfeec0a8daae1113 Sep 23 15:13:23.541241 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Project-Name: admin Sep 23 15:13:23.541241 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Role: reader,member,admin Sep 23 15:13:23.541241 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Roles: reader,member,admin Sep 23 15:13:23.544931 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/23b5c58d198d4456bfeec0a8daae1113"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/23b5c58d198d4456bfeec0a8daae1113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_23b5c58d198d4456bfeec0a8daae1113", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/23b5c58d198d4456bfeec0a8daae1113"}]}] Sep 23 15:13:23.544931 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Tenant: admin Sep 23 15:13:23.544931 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Tenant-Id: 23b5c58d198d4456bfeec0a8daae1113 Sep 23 15:13:23.544931 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Tenant-Name: admin Sep 23 15:13:23.544931 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-User: admin Sep 23 15:13:23.544931 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-User-Domain-Id: default Sep 23 15:13:23.544931 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-User-Domain-Name: Default Sep 23 15:13:23.544931 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-User-Id: 0fc10e0211a54a0faf7ea9b86542de03 Sep 23 15:13:23.544931 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-User-Name: admin Sep 23 15:13:23.544931 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: method: > Sep 23 15:13:23.544931 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: exception: Flavor 42 could not be found. Sep 23 15:13:23.544931 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: action_args: {'id': '42'} Sep 23 15:13:23.544931 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:13:23.544931 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:13:23.545742 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 15:13:23.545742 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 15:13:23.545742 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 15:13:23.545742 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 15:13:23.545742 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 15:13:23.545742 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 15:13:23.545742 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 15:13:23.545742 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 15:13:23.545742 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 15:13:23.545742 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:13:23.545742 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 15:13:23.545742 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 15:13:23.545742 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 23 15:13:23.545742 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi Sep 23 15:13:23.545742 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:13:23.545742 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi Sep 23 15:13:23.545742 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:13:23.545742 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:13:23.545742 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:13:23.547395 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:13:23.547395 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:13:23.547395 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:13:23.547395 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:13:23.547395 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 15:13:23.547395 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:13:23.547395 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 23 15:13:23.547395 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi Sep 23 15:13:23.547395 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:13:23.547395 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi Sep 23 15:13:23.547395 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:13:23.547395 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:13:23.547395 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:13:23.547395 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:13:23.547395 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:13:23.547395 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 23 15:13:23.547395 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi Sep 23 15:13:23.547395 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-b563899a-0f4e-4715-b1f8-4f6c2b665abf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:13:23.548465 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-b563899a-0f4e-4715-b1f8-4f6c2b665abf admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014417 Sep 23 15:13:23.548465 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 22/42] 10.222.0.55 () {60 vars in 1190 bytes} [Fri Sep 23 15:13:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 15:13:24.812525 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-86c3c40f-5c56-49c3-acbd-cca83c022ceb admin admin] Calling method '>' {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:13:24.813578 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-86c3c40f-5c56-49c3-acbd-cca83c022ceb admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001750 Sep 23 15:13:24.813967 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 21/43] 10.222.0.55 () {56 vars in 1074 bytes} [Fri Sep 23 15:13:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:13:25.350772 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-e7268886-74ad-405f-a99d-930779f9ce70 admin admin] Calling method '>' {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:13:25.355862 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.wsgi [None req-e7268886-74ad-405f-a99d-930779f9ce70 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 23 15:13:25.357473 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-e7268886-74ad-405f-a99d-930779f9ce70 admin admin] Request method failure captured: Sep 23 15:13:25.357473 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 23 15:13:25.357473 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: Accept: application/json Sep 23 15:13:25.357473 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: Accept-Encoding: gzip, deflate Sep 23 15:13:25.357473 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: Connection: keep-alive Sep 23 15:13:25.357473 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: Content-Length: 0 Sep 23 15:13:25.357473 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: Host: 10.222.0.55 Sep 23 15:13:25.357473 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: Openstack-Api-Version: compute 2.92 Sep 23 15:13:25.357473 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: Openstack-System-Scope: None Sep 23 15:13:25.357473 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: User-Agent: python-novaclient Sep 23 15:13:25.357473 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Auth-Token: gAAAAABjLc0UhCOntFOb7oRW8BAk8-c39u3HxYV7FDsl3srwStPBIQ71v1kiKfIc0pe6A3RX8LGPtaBqkta4uiIU1doVkDOcdoTdGzYRUTHXHzmkgcmgh3fe29dftTG31q6QDdLkZLLOVuUBaoSLCaA63qrkCqRZdCywSbZLnFJh1D_PuqgNW1I Sep 23 15:13:25.357473 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Domain-Id: None Sep 23 15:13:25.357473 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Domain-Name: None Sep 23 15:13:25.357473 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Identity-Status: Confirmed Sep 23 15:13:25.357473 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Is-Admin-Project: True Sep 23 15:13:25.357473 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 15:13:25.357473 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Project-Domain-Id: default Sep 23 15:13:25.357473 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Project-Domain-Name: Default Sep 23 15:13:25.357473 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Project-Id: 23b5c58d198d4456bfeec0a8daae1113 Sep 23 15:13:25.357473 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Project-Name: admin Sep 23 15:13:25.357473 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Role: reader,member,admin Sep 23 15:13:25.357473 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Roles: reader,member,admin Sep 23 15:13:25.359574 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/23b5c58d198d4456bfeec0a8daae1113"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/23b5c58d198d4456bfeec0a8daae1113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_23b5c58d198d4456bfeec0a8daae1113", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/23b5c58d198d4456bfeec0a8daae1113"}]}] Sep 23 15:13:25.359574 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Tenant: admin Sep 23 15:13:25.359574 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Tenant-Id: 23b5c58d198d4456bfeec0a8daae1113 Sep 23 15:13:25.359574 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Tenant-Name: admin Sep 23 15:13:25.359574 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-User: admin Sep 23 15:13:25.359574 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-User-Domain-Id: default Sep 23 15:13:25.359574 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-User-Domain-Name: Default Sep 23 15:13:25.359574 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-User-Id: 0fc10e0211a54a0faf7ea9b86542de03 Sep 23 15:13:25.359574 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-User-Name: admin Sep 23 15:13:25.359574 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: method: > Sep 23 15:13:25.359574 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: exception: Flavor 84 could not be found. Sep 23 15:13:25.359574 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: action_args: {'id': '84'} Sep 23 15:13:25.359574 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:13:25.359574 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:13:25.360412 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 15:13:25.360412 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 15:13:25.360412 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 15:13:25.360412 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 15:13:25.360412 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 15:13:25.360412 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 15:13:25.360412 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 15:13:25.360412 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 15:13:25.360412 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 15:13:25.360412 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:13:25.360412 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 15:13:25.360412 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 15:13:25.360412 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 23 15:13:25.360412 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi Sep 23 15:13:25.360412 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:13:25.360412 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi Sep 23 15:13:25.360412 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:13:25.360412 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:13:25.360412 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:13:25.361657 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:13:25.361657 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:13:25.361657 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:13:25.361657 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:13:25.361657 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 15:13:25.361657 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:13:25.361657 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 23 15:13:25.361657 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi Sep 23 15:13:25.361657 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:13:25.361657 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi Sep 23 15:13:25.361657 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:13:25.361657 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:13:25.361657 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:13:25.361657 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:13:25.361657 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:13:25.361657 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 23 15:13:25.361657 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi Sep 23 15:13:25.361657 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-e7268886-74ad-405f-a99d-930779f9ce70 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:13:25.362886 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-e7268886-74ad-405f-a99d-930779f9ce70 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.409139 Sep 23 15:13:25.362886 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 23/44] 10.222.0.55 () {60 vars in 1190 bytes} [Fri Sep 23 15:13:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 411 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 23 15:13:25.369996 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-e10f9ea0-f52a-4fa7-a164-0b27e452a11b admin admin] Calling method '>' {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:13:25.384838 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-e10f9ea0-f52a-4fa7-a164-0b27e452a11b admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018502 Sep 23 15:13:25.385361 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 22/45] 10.222.0.55 () {60 vars in 1210 bytes} [Fri Sep 23 15:13:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:13:25.395709 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-61ef8155-616d-40bf-97b8-a3f729b7a8d8 admin admin] Calling method '>' {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:13:25.412617 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-61ef8155-616d-40bf-97b8-a3f729b7a8d8 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020705 Sep 23 15:13:25.413144 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 24/46] 10.222.0.55 () {60 vars in 1210 bytes} [Fri Sep 23 15:13:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:13:25.423005 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-961fec24-a75d-4a40-b68f-81eed5585c3f admin admin] Calling method '>' {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:13:25.428357 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.wsgi [None req-961fec24-a75d-4a40-b68f-81eed5585c3f admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 23 15:13:25.429903 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-961fec24-a75d-4a40-b68f-81eed5585c3f admin admin] Request method failure captured: Sep 23 15:13:25.429903 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 23 15:13:25.429903 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: Accept: application/json Sep 23 15:13:25.429903 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: Accept-Encoding: gzip, deflate Sep 23 15:13:25.429903 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: Connection: keep-alive Sep 23 15:13:25.429903 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: Content-Length: 0 Sep 23 15:13:25.429903 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: Host: 10.222.0.55 Sep 23 15:13:25.429903 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: Openstack-Api-Version: compute 2.92 Sep 23 15:13:25.429903 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: Openstack-System-Scope: None Sep 23 15:13:25.429903 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: User-Agent: python-novaclient Sep 23 15:13:25.429903 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Auth-Token: gAAAAABjLc0UhCOntFOb7oRW8BAk8-c39u3HxYV7FDsl3srwStPBIQ71v1kiKfIc0pe6A3RX8LGPtaBqkta4uiIU1doVkDOcdoTdGzYRUTHXHzmkgcmgh3fe29dftTG31q6QDdLkZLLOVuUBaoSLCaA63qrkCqRZdCywSbZLnFJh1D_PuqgNW1I Sep 23 15:13:25.429903 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Domain-Id: None Sep 23 15:13:25.429903 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Domain-Name: None Sep 23 15:13:25.429903 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Identity-Status: Confirmed Sep 23 15:13:25.429903 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Is-Admin-Project: True Sep 23 15:13:25.429903 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 15:13:25.429903 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Project-Domain-Id: default Sep 23 15:13:25.429903 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Project-Domain-Name: Default Sep 23 15:13:25.429903 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Project-Id: 23b5c58d198d4456bfeec0a8daae1113 Sep 23 15:13:25.429903 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Project-Name: admin Sep 23 15:13:25.429903 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Role: reader,member,admin Sep 23 15:13:25.429903 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Roles: reader,member,admin Sep 23 15:13:25.431441 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/23b5c58d198d4456bfeec0a8daae1113"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/23b5c58d198d4456bfeec0a8daae1113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_23b5c58d198d4456bfeec0a8daae1113", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/23b5c58d198d4456bfeec0a8daae1113"}]}] Sep 23 15:13:25.431441 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Tenant: admin Sep 23 15:13:25.431441 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Tenant-Id: 23b5c58d198d4456bfeec0a8daae1113 Sep 23 15:13:25.431441 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Tenant-Name: admin Sep 23 15:13:25.431441 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-User: admin Sep 23 15:13:25.431441 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-User-Domain-Id: default Sep 23 15:13:25.431441 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-User-Domain-Name: Default Sep 23 15:13:25.431441 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-User-Id: 0fc10e0211a54a0faf7ea9b86542de03 Sep 23 15:13:25.431441 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-User-Name: admin Sep 23 15:13:25.431441 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: method: > Sep 23 15:13:25.431441 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: exception: Flavor 84 could not be found. Sep 23 15:13:25.431441 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: action_args: {'id': '84'} Sep 23 15:13:25.431441 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:13:25.431441 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:13:25.432427 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 15:13:25.432427 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 15:13:25.432427 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 15:13:25.432427 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 15:13:25.432427 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 15:13:25.432427 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 15:13:25.432427 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 15:13:25.432427 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 15:13:25.432427 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 15:13:25.432427 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:13:25.432427 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 15:13:25.432427 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 15:13:25.432427 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 23 15:13:25.432427 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi Sep 23 15:13:25.432427 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:13:25.432427 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi Sep 23 15:13:25.432427 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:13:25.432427 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:13:25.432427 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:13:25.433789 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:13:25.433789 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:13:25.433789 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:13:25.433789 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:13:25.433789 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 15:13:25.433789 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:13:25.433789 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 23 15:13:25.433789 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi Sep 23 15:13:25.433789 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:13:25.433789 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi Sep 23 15:13:25.433789 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:13:25.433789 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:13:25.433789 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:13:25.433789 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:13:25.433789 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:13:25.433789 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 23 15:13:25.433789 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi Sep 23 15:13:25.433789 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-961fec24-a75d-4a40-b68f-81eed5585c3f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:13:25.435164 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-961fec24-a75d-4a40-b68f-81eed5585c3f admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012424 Sep 23 15:13:25.435164 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 23/47] 10.222.0.55 () {60 vars in 1190 bytes} [Fri Sep 23 15:13:25 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 15:13:26.659231 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-61ef8155-616d-40bf-97b8-a3f729b7a8d8 admin admin] Calling method '>' {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:13:26.660254 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-61ef8155-616d-40bf-97b8-a3f729b7a8d8 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Sep 23 15:13:26.660677 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 25/48] 10.222.0.55 () {56 vars in 1074 bytes} [Fri Sep 23 15:13:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:13:27.189078 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-b98803c1-3be6-4109-87ae-27564f8aedd7 admin admin] Calling method '>' {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:13:27.195115 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.wsgi [None req-b98803c1-3be6-4109-87ae-27564f8aedd7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 23 15:13:27.196751 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-b98803c1-3be6-4109-87ae-27564f8aedd7 admin admin] Request method failure captured: Sep 23 15:13:27.196751 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 23 15:13:27.196751 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: Accept: application/json Sep 23 15:13:27.196751 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: Accept-Encoding: gzip, deflate Sep 23 15:13:27.196751 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: Connection: keep-alive Sep 23 15:13:27.196751 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: Content-Length: 0 Sep 23 15:13:27.196751 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: Host: 10.222.0.55 Sep 23 15:13:27.196751 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: Openstack-Api-Version: compute 2.92 Sep 23 15:13:27.196751 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: Openstack-System-Scope: None Sep 23 15:13:27.196751 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: User-Agent: python-novaclient Sep 23 15:13:27.196751 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Auth-Token: gAAAAABjLc0Wp7P6ZUwTEkt-zF7krHQsdiwd_tGAy6Lv1C2sOZrHaZrwqAwX5OqVd7XkryS9lbymZxhL0c5iBNFNi4eLxznRaONJLYu_H0-LHYVMJg6ynjQ7pX8OKeYqMq-y9XDT24fVMb3ecHvzV5WimnAqTWS6d6pg3qeiUp8O0Mg8gFoSqd8 Sep 23 15:13:27.196751 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Domain-Id: None Sep 23 15:13:27.196751 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Domain-Name: None Sep 23 15:13:27.196751 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Identity-Status: Confirmed Sep 23 15:13:27.196751 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Is-Admin-Project: True Sep 23 15:13:27.196751 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 15:13:27.196751 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Project-Domain-Id: default Sep 23 15:13:27.196751 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Project-Domain-Name: Default Sep 23 15:13:27.196751 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Project-Id: 23b5c58d198d4456bfeec0a8daae1113 Sep 23 15:13:27.196751 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Project-Name: admin Sep 23 15:13:27.196751 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Role: reader,member,admin Sep 23 15:13:27.196751 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Roles: reader,member,admin Sep 23 15:13:27.198382 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/23b5c58d198d4456bfeec0a8daae1113"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/23b5c58d198d4456bfeec0a8daae1113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_23b5c58d198d4456bfeec0a8daae1113", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/23b5c58d198d4456bfeec0a8daae1113"}]}] Sep 23 15:13:27.198382 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Tenant: admin Sep 23 15:13:27.198382 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Tenant-Id: 23b5c58d198d4456bfeec0a8daae1113 Sep 23 15:13:27.198382 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-Tenant-Name: admin Sep 23 15:13:27.198382 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-User: admin Sep 23 15:13:27.198382 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-User-Domain-Id: default Sep 23 15:13:27.198382 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-User-Domain-Name: Default Sep 23 15:13:27.198382 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-User-Id: 0fc10e0211a54a0faf7ea9b86542de03 Sep 23 15:13:27.198382 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: X-User-Name: admin Sep 23 15:13:27.198382 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: method: > Sep 23 15:13:27.198382 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: exception: Flavor 451 could not be found. Sep 23 15:13:27.198382 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: action_args: {'id': '451'} Sep 23 15:13:27.198382 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:13:27.198382 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:13:27.199335 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 15:13:27.199335 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 15:13:27.199335 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 15:13:27.199335 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 15:13:27.199335 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 15:13:27.199335 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 15:13:27.199335 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 15:13:27.199335 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 15:13:27.199335 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 15:13:27.199335 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:13:27.199335 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 15:13:27.199335 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 15:13:27.199335 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 23 15:13:27.199335 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi Sep 23 15:13:27.199335 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:13:27.199335 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi Sep 23 15:13:27.199335 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:13:27.199335 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:13:27.199335 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:13:27.200880 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:13:27.200880 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:13:27.200880 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:13:27.200880 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:13:27.200880 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 15:13:27.200880 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:13:27.200880 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 23 15:13:27.200880 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi Sep 23 15:13:27.200880 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:13:27.200880 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi Sep 23 15:13:27.200880 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:13:27.200880 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:13:27.200880 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:13:27.200880 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:13:27.200880 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:13:27.200880 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 23 15:13:27.200880 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: ERROR nova.api.openstack.wsgi Sep 23 15:13:27.200880 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-b98803c1-3be6-4109-87ae-27564f8aedd7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:13:27.202852 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-b98803c1-3be6-4109-87ae-27564f8aedd7 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.399629 Sep 23 15:13:27.202852 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 24/49] 10.222.0.55 () {60 vars in 1193 bytes} [Fri Sep 23 15:13:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 15:13:27.208799 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-24c0a28d-ce6e-4bca-a7bc-42a0d5c23413 admin admin] Calling method '>' {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:13:27.225096 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-24c0a28d-ce6e-4bca-a7bc-42a0d5c23413 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019911 Sep 23 15:13:27.225669 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 26/50] 10.222.0.55 () {60 vars in 1210 bytes} [Fri Sep 23 15:13:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:13:27.235428 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-15698280-9ba8-4cb1-ae88-a12d90297f6f admin admin] Calling method '>' {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:13:27.250791 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-15698280-9ba8-4cb1-ae88-a12d90297f6f admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019046 Sep 23 15:13:27.251319 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 25/51] 10.222.0.55 () {60 vars in 1210 bytes} [Fri Sep 23 15:13:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:13:27.260548 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-9d77703c-0bed-47a4-a1ce-4c767cdcb443 admin admin] Calling method '>' {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:13:27.266408 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.wsgi [None req-9d77703c-0bed-47a4-a1ce-4c767cdcb443 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 23 15:13:27.268177 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-9d77703c-0bed-47a4-a1ce-4c767cdcb443 admin admin] Request method failure captured: Sep 23 15:13:27.268177 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 23 15:13:27.268177 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: Accept: application/json Sep 23 15:13:27.268177 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: Accept-Encoding: gzip, deflate Sep 23 15:13:27.268177 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: Connection: keep-alive Sep 23 15:13:27.268177 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: Content-Length: 0 Sep 23 15:13:27.268177 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: Host: 10.222.0.55 Sep 23 15:13:27.268177 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: Openstack-Api-Version: compute 2.92 Sep 23 15:13:27.268177 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: Openstack-System-Scope: None Sep 23 15:13:27.268177 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: User-Agent: python-novaclient Sep 23 15:13:27.268177 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Auth-Token: gAAAAABjLc0Wp7P6ZUwTEkt-zF7krHQsdiwd_tGAy6Lv1C2sOZrHaZrwqAwX5OqVd7XkryS9lbymZxhL0c5iBNFNi4eLxznRaONJLYu_H0-LHYVMJg6ynjQ7pX8OKeYqMq-y9XDT24fVMb3ecHvzV5WimnAqTWS6d6pg3qeiUp8O0Mg8gFoSqd8 Sep 23 15:13:27.268177 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Domain-Id: None Sep 23 15:13:27.268177 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Domain-Name: None Sep 23 15:13:27.268177 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Identity-Status: Confirmed Sep 23 15:13:27.268177 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Is-Admin-Project: True Sep 23 15:13:27.268177 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 15:13:27.268177 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Project-Domain-Id: default Sep 23 15:13:27.268177 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Project-Domain-Name: Default Sep 23 15:13:27.268177 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Project-Id: 23b5c58d198d4456bfeec0a8daae1113 Sep 23 15:13:27.268177 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Project-Name: admin Sep 23 15:13:27.268177 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Role: reader,member,admin Sep 23 15:13:27.268177 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Roles: reader,member,admin Sep 23 15:13:27.269777 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/23b5c58d198d4456bfeec0a8daae1113"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/23b5c58d198d4456bfeec0a8daae1113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_23b5c58d198d4456bfeec0a8daae1113", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/23b5c58d198d4456bfeec0a8daae1113"}]}] Sep 23 15:13:27.269777 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Tenant: admin Sep 23 15:13:27.269777 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Tenant-Id: 23b5c58d198d4456bfeec0a8daae1113 Sep 23 15:13:27.269777 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-Tenant-Name: admin Sep 23 15:13:27.269777 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-User: admin Sep 23 15:13:27.269777 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-User-Domain-Id: default Sep 23 15:13:27.269777 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-User-Domain-Name: Default Sep 23 15:13:27.269777 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-User-Id: 0fc10e0211a54a0faf7ea9b86542de03 Sep 23 15:13:27.269777 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: X-User-Name: admin Sep 23 15:13:27.269777 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: method: > Sep 23 15:13:27.269777 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: exception: Flavor 451 could not be found. Sep 23 15:13:27.269777 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: action_args: {'id': '451'} Sep 23 15:13:27.269777 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:13:27.269777 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:13:27.270809 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 15:13:27.270809 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 15:13:27.270809 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 15:13:27.270809 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 15:13:27.270809 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 15:13:27.270809 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 15:13:27.270809 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 15:13:27.270809 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 15:13:27.270809 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 15:13:27.270809 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:13:27.270809 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 15:13:27.270809 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 15:13:27.270809 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 23 15:13:27.270809 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi Sep 23 15:13:27.270809 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:13:27.270809 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi Sep 23 15:13:27.270809 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:13:27.270809 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:13:27.270809 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:13:27.271954 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:13:27.271954 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:13:27.271954 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:13:27.271954 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:13:27.271954 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 15:13:27.271954 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:13:27.271954 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 23 15:13:27.271954 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi Sep 23 15:13:27.271954 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:13:27.271954 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi Sep 23 15:13:27.271954 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:13:27.271954 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:13:27.271954 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:13:27.271954 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:13:27.271954 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:13:27.271954 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 23 15:13:27.271954 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: ERROR nova.api.openstack.wsgi Sep 23 15:13:27.271954 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-9d77703c-0bed-47a4-a1ce-4c767cdcb443 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:13:27.273051 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-9d77703c-0bed-47a4-a1ce-4c767cdcb443 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012525 Sep 23 15:13:27.273051 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 27/52] 10.222.0.55 () {60 vars in 1193 bytes} [Fri Sep 23 15:13:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 15:13:28.495995 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-15698280-9ba8-4cb1-ae88-a12d90297f6f admin admin] Calling method '>' {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:13:28.497002 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-15698280-9ba8-4cb1-ae88-a12d90297f6f admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 23 15:13:28.497396 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 26/53] 10.222.0.55 () {56 vars in 1074 bytes} [Fri Sep 23 15:13:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:13:29.032004 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-f26dfad5-f604-4a9b-ad32-5fb89285c5ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:13:29.172604 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-f26dfad5-f604-4a9b-ad32-5fb89285c5ce admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.536195 Sep 23 15:13:29.173084 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 28/54] 10.222.0.55 () {64 vars in 1235 bytes} [Fri Sep 23 15:13:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:13:30.403838 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-15698280-9ba8-4cb1-ae88-a12d90297f6f admin admin] Calling method '>' {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:13:30.404869 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-15698280-9ba8-4cb1-ae88-a12d90297f6f admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 23 15:13:30.405366 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 27/55] 10.222.0.55 () {56 vars in 1074 bytes} [Fri Sep 23 15:13:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:13:30.942067 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-e65b8df3-a8d2-4377-9f3e-484dcfd85cc1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:13:31.069161 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-e65b8df3-a8d2-4377-9f3e-484dcfd85cc1 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.525690 Sep 23 15:13:31.069716 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 29/56] 10.222.0.55 () {64 vars in 1235 bytes} [Fri Sep 23 15:13:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:13:32.295671 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-15698280-9ba8-4cb1-ae88-a12d90297f6f admin admin] Calling method '>' {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:13:32.297434 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-15698280-9ba8-4cb1-ae88-a12d90297f6f admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002083 Sep 23 15:13:32.297745 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 28/57] 10.222.0.55 () {56 vars in 1074 bytes} [Fri Sep 23 15:13:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:13:32.844360 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-6daadaa2-7744-484a-9d6b-092496b8a8d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:13:32.943638 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-6daadaa2-7744-484a-9d6b-092496b8a8d9 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.502622 Sep 23 15:13:32.944223 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 30/58] 10.222.0.55 () {64 vars in 1235 bytes} [Fri Sep 23 15:13:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:13:34.177275 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-15698280-9ba8-4cb1-ae88-a12d90297f6f admin admin] Calling method '>' {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:13:34.178290 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-15698280-9ba8-4cb1-ae88-a12d90297f6f admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 23 15:13:34.178674 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 29/59] 10.222.0.55 () {56 vars in 1074 bytes} [Fri Sep 23 15:13:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:13:34.717283 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-d9a413f1-8fad-4c25-ad18-da69b185d00c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:13:34.799970 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-d9a413f1-8fad-4c25-ad18-da69b185d00c admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.481854 Sep 23 15:13:34.800543 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 31/60] 10.222.0.55 () {64 vars in 1235 bytes} [Fri Sep 23 15:13:34 2022] POST /compute/v2.1/flavors => generated 409 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:13:36.030420 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-15698280-9ba8-4cb1-ae88-a12d90297f6f admin admin] Calling method '>' {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:13:36.031456 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-15698280-9ba8-4cb1-ae88-a12d90297f6f admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Sep 23 15:13:36.031843 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 30/61] 10.222.0.55 () {56 vars in 1074 bytes} [Fri Sep 23 15:13:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:13:36.559516 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-28db7ef8-3324-4d49-ad44-1f8d26b834d8 admin admin] Calling method '>' {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:13:36.580323 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-28db7ef8-3324-4d49-ad44-1f8d26b834d8 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.411023 Sep 23 15:13:36.580857 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 32/62] 10.222.0.55 () {60 vars in 1202 bytes} [Fri Sep 23 15:13:36 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:14:35.260336 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-15698280-9ba8-4cb1-ae88-a12d90297f6f admin admin] Calling method '>' {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:14:35.261810 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-15698280-9ba8-4cb1-ae88-a12d90297f6f admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001934 Sep 23 15:14:35.262433 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 31/63] 10.222.0.55 () {54 vars in 931 bytes} [Fri Sep 23 15:14:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:14:35.276033 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG dbcounter [-] [106350] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:14:35.734707 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-b1874810-a22c-4b82-a3ed-694821ce27a4 admin admin] Calling method '>' {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:14:35.756623 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-b1874810-a22c-4b82-a3ed-694821ce27a4 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.485635 Sep 23 15:14:35.757174 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 33/64] 10.222.0.55 () {60 vars in 1292 bytes} [Fri Sep 23 15:14:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:14:35.781449 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG dbcounter [-] [106351] Writing DB stats nova_api:SELECT=14 {{(pid=106351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:14:35.785765 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-262cf1a0-7355-4235-b2c0-c76e9cae20ac admin admin] Calling method '>' {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:14:35.793780 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-262cf1a0-7355-4235-b2c0-c76e9cae20ac admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014558 Sep 23 15:14:35.794341 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 32/65] 10.222.0.55 () {60 vars in 1283 bytes} [Fri Sep 23 15:14:35 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:14:35.807076 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-2456039a-be40-4990-897a-41ab50b53b82 admin admin] Calling method '>' {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:14:35.815907 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-2456039a-be40-4990-897a-41ab50b53b82 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012428 Sep 23 15:14:35.816607 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 34/66] 10.222.0.55 () {60 vars in 1286 bytes} [Fri Sep 23 15:14:35 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:14:35.830252 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-fc105065-c101-4948-bd4d-66d9a00b24ac admin admin] Calling method '>' {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:14:35.838507 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-fc105065-c101-4948-bd4d-66d9a00b24ac admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013362 Sep 23 15:14:35.839076 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 33/67] 10.222.0.55 () {60 vars in 1286 bytes} [Fri Sep 23 15:14:35 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:14:35.853907 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-082923c6-a8ca-4bd8-99ca-84ce7db836d1 admin admin] Calling method '>' {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:14:35.862382 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-082923c6-a8ca-4bd8-99ca-84ce7db836d1 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012231 Sep 23 15:14:35.862944 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 35/68] 10.222.0.55 () {60 vars in 1283 bytes} [Fri Sep 23 15:14:35 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:17:58.795593 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-fc105065-c101-4948-bd4d-66d9a00b24ac admin admin] Calling method '>' {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:17:58.796700 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-fc105065-c101-4948-bd4d-66d9a00b24ac admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002327 Sep 23 15:17:58.797098 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 34/69] 10.222.0.55 () {56 vars in 1074 bytes} [Fri Sep 23 15:17:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:17:58.941364 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG dbcounter [-] [106350] Writing DB stats nova_api:SELECT=6 {{(pid=106350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:17:59.106869 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-2350b3f3-6811-45ca-af0c-da1de8522b23 admin admin] Calling method '>' {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:17:59.112914 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-2350b3f3-6811-45ca-af0c-da1de8522b23 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:17:59.113442 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-2350b3f3-6811-45ca-af0c-da1de8522b23 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:17:59.113885 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-2350b3f3-6811-45ca-af0c-da1de8522b23 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:17:59.114608 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-2350b3f3-6811-45ca-af0c-da1de8522b23 admin admin] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:17:59.115060 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-2350b3f3-6811-45ca-af0c-da1de8522b23 admin admin] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:17:59.115478 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-2350b3f3-6811-45ca-af0c-da1de8522b23 admin admin] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:17:59.151555 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-2350b3f3-6811-45ca-af0c-da1de8522b23 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.211294 Sep 23 15:17:59.152162 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 36/70] 10.222.0.55 () {60 vars in 1193 bytes} [Fri Sep 23 15:17:58 2022] GET /compute/v2.1/os-services => generated 791 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:18:00.328703 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-fc105065-c101-4948-bd4d-66d9a00b24ac admin admin] Calling method '>' {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:00.329702 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-fc105065-c101-4948-bd4d-66d9a00b24ac admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 23 15:18:00.330144 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 35/71] 10.222.0.55 () {56 vars in 1074 bytes} [Fri Sep 23 15:18:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:18:00.523671 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-09379ce5-bea6-402b-912a-42e2a42e9dc7 admin admin] Calling method '>' {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:00.527101 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-09379ce5-bea6-402b-912a-42e2a42e9dc7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:00.527566 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-09379ce5-bea6-402b-912a-42e2a42e9dc7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:00.528014 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-09379ce5-bea6-402b-912a-42e2a42e9dc7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:00.528714 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-09379ce5-bea6-402b-912a-42e2a42e9dc7 admin admin] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:00.529229 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-09379ce5-bea6-402b-912a-42e2a42e9dc7 admin admin] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:00.529752 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-09379ce5-bea6-402b-912a-42e2a42e9dc7 admin admin] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:00.550321 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-09379ce5-bea6-402b-912a-42e2a42e9dc7 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.081465 Sep 23 15:18:00.550892 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 37/72] 10.222.0.55 () {60 vars in 1193 bytes} [Fri Sep 23 15:18:00 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:18:12.101151 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-fc105065-c101-4948-bd4d-66d9a00b24ac admin admin] Calling method '>' {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:12.102631 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-fc105065-c101-4948-bd4d-66d9a00b24ac admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Sep 23 15:18:12.103050 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 36/73] 10.222.0.55 () {56 vars in 1074 bytes} [Fri Sep 23 15:18:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:18:12.246336 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG dbcounter [-] [106350] Writing DB stats nova_cell0:SELECT=4 {{(pid=106350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:18:12.247062 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG dbcounter [-] [106350] Writing DB stats nova_cell1:SELECT=4 {{(pid=106350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:18:12.247691 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG dbcounter [-] [106350] Writing DB stats nova_api:SELECT=8 {{(pid=106350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:18:12.298044 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-1254704a-5132-4126-a414-fc7f1aa062dd admin admin] Calling method '>' {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:12.301554 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-1254704a-5132-4126-a414-fc7f1aa062dd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:12.302033 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-1254704a-5132-4126-a414-fc7f1aa062dd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:12.302462 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-1254704a-5132-4126-a414-fc7f1aa062dd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:12.303180 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-1254704a-5132-4126-a414-fc7f1aa062dd admin admin] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:12.303626 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-1254704a-5132-4126-a414-fc7f1aa062dd admin admin] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:12.304062 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-1254704a-5132-4126-a414-fc7f1aa062dd admin admin] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:12.334847 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-1254704a-5132-4126-a414-fc7f1aa062dd admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.087604 Sep 23 15:18:12.334847 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 38/74] 10.222.0.55 () {60 vars in 1193 bytes} [Fri Sep 23 15:18:12 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:18:13.454541 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG nova.api.openstack.wsgi [None req-fc105065-c101-4948-bd4d-66d9a00b24ac admin admin] Calling method '>' {{(pid=106351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:13.455576 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: INFO nova.api.openstack.requestlog [None req-fc105065-c101-4948-bd4d-66d9a00b24ac admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 23 15:18:13.455970 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: [pid: 106351|app: 0|req: 37/75] 10.222.0.55 () {56 vars in 1074 bytes} [Fri Sep 23 15:18:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:18:13.651390 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG nova.api.openstack.wsgi [None req-177bcaec-d30d-43d9-a10e-be31750dd57a admin admin] Calling method '>' {{(pid=106350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:13.655623 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-177bcaec-d30d-43d9-a10e-be31750dd57a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:13.656147 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-177bcaec-d30d-43d9-a10e-be31750dd57a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:13.656579 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-177bcaec-d30d-43d9-a10e-be31750dd57a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:13.657291 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-177bcaec-d30d-43d9-a10e-be31750dd57a admin admin] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:13.657759 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-177bcaec-d30d-43d9-a10e-be31750dd57a admin admin] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:13.658168 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: DEBUG oslo_concurrency.lockutils [None req-177bcaec-d30d-43d9-a10e-be31750dd57a admin admin] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:13.681173 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: INFO nova.api.openstack.requestlog [None req-177bcaec-d30d-43d9-a10e-be31750dd57a admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.085211 Sep 23 15:18:13.681748 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: [pid: 106350|app: 0|req: 39/76] 10.222.0.55 () {60 vars in 1193 bytes} [Fri Sep 23 15:18:13 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:19:12.160918 dv-cinder-855307-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 23 15:19:12.161837 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: Fri Sep 23 15:19:12 2022 - graceful shutdown triggered... Sep 23 15:19:12.162331 dv-cinder-855307-2-iscsi devstack@n-api.service[106350]: Gracefully killing worker 1 (pid: 106350)... Sep 23 15:19:12.162841 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: Gracefully killing worker 2 (pid: 106351)... Sep 23 15:19:12.288936 dv-cinder-855307-2-iscsi devstack@n-api.service[106351]: DEBUG dbcounter [-] [106351] Writing DB stats nova_api:SELECT=4 {{(pid=106351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:19:13.162987 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: worker 1 buried after 1 seconds Sep 23 15:19:13.162987 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: worker 2 buried after 1 seconds Sep 23 15:19:13.162987 dv-cinder-855307-2-iscsi devstack@n-api.service[106349]: goodbye to uWSGI. Sep 23 15:19:13.164544 dv-cinder-855307-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 23 15:19:13.165124 dv-cinder-855307-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 23 15:19:13.167912 dv-cinder-855307-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 23 15:19:13.181013 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 23 15:19:13.189151 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 23 15:19:13 2022] *** Sep 23 15:19:13.189151 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 23 15:19:13.189151 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 23 15:19:13.189151 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: nodename: dv-cinder-855307-2-iscsi Sep 23 15:19:13.189151 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: machine: x86_64 Sep 23 15:19:13.189151 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: clock source: unix Sep 23 15:19:13.189151 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: pcre jit disabled Sep 23 15:19:13.189151 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: detected number of CPU cores: 4 Sep 23 15:19:13.189151 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: current working directory: / Sep 23 15:19:13.189151 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: detected binary path: /usr/bin/uwsgi-core Sep 23 15:19:13.189151 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: your processes number limit is 47680 Sep 23 15:19:13.189151 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: your memory page size is 4096 bytes Sep 23 15:19:13.189151 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: detected max file descriptor number: 2048 Sep 23 15:19:13.189151 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: lock engine: pthread robust mutexes Sep 23 15:19:13.189151 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: thunder lock: enabled Sep 23 15:19:13.189151 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 23 15:19:13.189151 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 23 15:19:13.224869 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: Python main interpreter initialized at 0x561cccaf19c0 Sep 23 15:19:13.224869 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: python threads support enabled Sep 23 15:19:13.224869 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: your server socket listen backlog is limited to 100 connections Sep 23 15:19:13.224869 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: your mercy for graceful operations on workers is 90 seconds Sep 23 15:19:13.228555 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: mapped 403077 bytes (393 KB) for 2 cores Sep 23 15:19:13.228555 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: *** Operational MODE: preforking *** Sep 23 15:19:13.228555 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: *** uWSGI is running in multiple interpreter mode *** Sep 23 15:19:13.228555 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: spawned uWSGI master process (pid: 121429) Sep 23 15:19:13.228555 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: spawned uWSGI worker 1 (pid: 121448, cores: 1) Sep 23 15:19:13.225833 dv-cinder-855307-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 23 15:19:13.230493 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: spawned uWSGI worker 2 (pid: 121450, cores: 1) Sep 23 15:19:13.230664 dv-cinder-855307-2-iscsi devstack@n-api.service[121429]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 23 15:19:13.905969 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 23 15:19:13.925737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 23 15:19:15.156613 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 15:19:15.156613 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: from cryptography.utils import int_from_bytes Sep 23 15:19:15.157741 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 15:19:15.157741 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: from cryptography.utils import int_from_bytes Sep 23 15:19:15.157741 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 15:19:15.157741 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: from cryptography.utils import int_from_bytes Sep 23 15:19:15.158628 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 15:19:15.158628 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: from cryptography.utils import int_from_bytes Sep 23 15:19:17.652775 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 15:19:17.653523 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 15:19:17.653668 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 15:19:17.653931 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 15:19:17.654205 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 15:19:17.654610 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.654992 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.655580 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.656154 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.656501 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.656821 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.657149 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.657469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.657807 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.658071 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.658389 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.658893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855307-2-iscsi {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.659211 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.659581 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.659878 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.660227 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.660536 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.660893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.661201 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.661733 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.662957 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.662957 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.663149 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.663512 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.663822 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.664145 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.664484 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.664795 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.665123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.665434 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.665842 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855307-2-iscsi {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.666191 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.666509 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.666838 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.667300 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.667608 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.667919 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.668292 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.668649 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.668974 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.669317 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.669551 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 15:19:17.669982 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.670078 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 15:19:17.670170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.670270 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.670398 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 15:19:17.670543 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.670770 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 15:19:17.670865 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.671086 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 15:19:17.671201 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.672115 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.672237 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.672487 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.672614 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.672816 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.672936 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.673094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.673252 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.673391 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.673715 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.673826 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.674039 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.674135 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.674398 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.674506 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.674691 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.674799 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.674926 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.675132 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.675234 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.675544 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.675690 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.675917 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.676049 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.676258 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.676571 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.676700 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855307-2-iscsi {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.676877 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.677028 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.677184 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.677327 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.677494 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.677696 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.677805 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.678005 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.678106 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.678283 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.678395 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.678614 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.678718 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.678928 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.679032 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.679300 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.679441 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.679621 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.679756 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.680045 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.680157 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.680300 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.680402 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.680608 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.680713 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.680948 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.681048 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.681268 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.681374 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.681579 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.681679 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.681899 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.681998 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.682239 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.682418 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.682517 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.682611 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.682823 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.682929 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855307-2-iscsi {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.683125 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.683251 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.683445 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.683568 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.683780 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.683959 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.684150 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.684351 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.684454 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.684651 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.684751 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.684956 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.685057 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.685276 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.685376 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.685581 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.685675 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.685890 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.686021 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.686195 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.686301 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.686499 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.686622 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.686803 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.687861 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.687967 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.688115 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.688201 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.688298 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.688398 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.688484 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.688643 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.688803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.688958 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.689128 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.689232 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.689442 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.689549 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.689754 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.689847 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.690009 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.690108 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.690322 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.690421 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.690650 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.690749 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.690977 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.691077 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.691305 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.691401 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.691561 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.691668 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.691816 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.691909 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.692166 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.692263 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.692496 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.692670 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.692816 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.692967 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.693159 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.693322 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.693466 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.693611 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.693746 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.693884 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.694040 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.694186 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.694328 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.694473 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.694630 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.694777 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.694927 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.695073 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.695224 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.695365 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.695505 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.695652 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.695794 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.695933 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.696105 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.696211 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.696470 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.696589 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.696700 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.696807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.697025 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.697137 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.697337 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.697453 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.697643 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.697737 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.697945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.698044 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.698250 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.698357 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.698550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.698668 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.698868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.699036 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.699193 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.699417 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.699525 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.699665 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.699812 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.700023 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.700136 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.700443 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.700577 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.700751 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.700915 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.701069 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.701204 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.701324 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.701446 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.701621 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.701742 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.701973 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.702193 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.702340 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.702467 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.702758 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.702888 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.703068 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.703546 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.703674 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.703796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.703916 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.704067 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.704200 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.704315 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.704455 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.705683 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.705683 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.705946 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.706044 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.706130 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.706221 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.706312 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.706403 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.706498 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.706646 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.706743 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.706835 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.706947 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.707039 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.707259 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.707363 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.707456 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.707564 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.707652 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.707736 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.707834 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.707919 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.708037 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.708124 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.708773 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.708912 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.708912 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.709074 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.709152 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.709296 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.709380 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.709452 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.709528 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.709811 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.709913 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.710008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.710215 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.710336 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.710524 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.710623 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.710837 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.710938 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.711145 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.711235 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.711455 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.711546 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.711777 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.711879 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.712107 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.712213 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.712420 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.712517 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.712741 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.712854 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.713055 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.713184 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.713361 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.713459 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.713670 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.713783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.713981 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.714076 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.714291 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.714392 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.714634 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.714781 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.714948 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.715048 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.715259 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.715362 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.715567 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.715670 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.715876 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.715991 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.716230 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.716322 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.716538 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.716643 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.716846 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.716942 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.717172 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.717311 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.717460 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.717561 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:19:17.717769 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.717863 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.718074 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.718236 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.718522 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.718628 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.718826 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.718935 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.719154 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.719255 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.719485 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.719587 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.719867 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.720051 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.720198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.720304 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.720511 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.720604 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.720824 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.720916 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.721135 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.721238 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.721446 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.721547 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.721753 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.721844 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.722066 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.722168 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.722380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.722480 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.722687 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.722787 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.723012 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.723116 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.723325 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.723429 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.723632 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.723732 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.723945 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.724110 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.724278 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.724378 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.724585 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.724693 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.724902 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.725047 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.725215 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.725317 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.725526 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.725629 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.725840 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.726010 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.726151 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.726317 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.726653 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.726757 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.726969 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.727068 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.727280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.727418 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.727599 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.727706 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.727917 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.728037 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.728257 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.728351 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.728583 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.728687 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.728899 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.728991 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.729214 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.729305 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.729519 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.729622 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.729829 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.730614 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.730719 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.730806 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.730899 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.730995 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.731090 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.731180 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.731264 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.731390 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.731480 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.731596 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.731680 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.731943 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.732062 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.732295 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.732703 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.732944 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.733111 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.733268 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.733423 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.733568 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.734258 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.734494 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.734693 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.734891 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.735094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.735290 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.735488 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.735874 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.736093 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.736246 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.736400 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.736556 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.736709 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.736863 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.737007 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.737152 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.737303 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.737539 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.737687 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.737832 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.737976 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.738129 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.738129 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.738371 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.738689 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.739005 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.739328 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.739636 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.739952 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.740296 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.740613 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.740944 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.741259 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.741571 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.741898 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.742214 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.742525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.742875 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.743195 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.743510 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.743828 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.747796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.747957 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.748074 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.748191 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.748279 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.748366 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.748449 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.748530 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.748664 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.748780 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.748892 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.749015 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.749137 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.749258 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.749396 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.749544 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.749659 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.749786 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.749953 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.750099 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.750226 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.750351 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.750472 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.750472 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.750472 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.750472 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.750472 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.751551 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.751696 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.751835 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.751990 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.752144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.752276 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.752405 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.752746 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.752883 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.753013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.753013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.753013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.753388 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.753527 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.753527 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.753958 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.754107 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.754237 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.754381 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.754511 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.754648 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.754777 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.754914 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.755054 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.755198 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.755335 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.755465 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.755594 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.755730 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.755915 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.756134 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.756279 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.756535 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.756676 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.756884 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.757016 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.757371 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.757519 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.757851 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.757990 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.758401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.758702 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.758842 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.759354 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.759354 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.759634 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.759774 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.759950 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.760168 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.760410 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.760552 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.760870 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.761012 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.761613 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.761761 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.761911 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.762160 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.762350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.762819 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.762982 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.763240 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.763383 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.763687 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.763956 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.764361 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.764519 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.764651 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.764781 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.765052 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.765201 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.765392 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.765720 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.765875 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.766136 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.766271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.766516 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.766774 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.766916 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.767154 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.767292 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.767481 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.767907 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.768099 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.768759 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.769046 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.769382 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.769645 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.769952 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.770151 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.770473 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.770661 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.770921 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.771054 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.771368 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.771508 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.771775 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.772077 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.772228 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.772478 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.772626 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.773010 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.773162 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.773293 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.773433 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.773652 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.773796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.774047 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.774178 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.774365 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.774604 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.774746 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.774996 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.775135 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.775315 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.775539 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.775680 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.776004 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.776141 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.776360 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.776492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.776672 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.776915 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.777098 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.777375 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.777514 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.777709 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.777992 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.778134 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.778531 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.779253 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.779630 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.779630 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.780753 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.784108 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.784108 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.784369 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.784460 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.784460 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.784613 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.784697 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.784979 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.785150 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.785225 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.785225 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.785363 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.785444 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.785518 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.785597 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.785669 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.785739 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.785817 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.785897 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.785969 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.786039 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.786110 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.786188 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.786260 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.786352 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.786433 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.786513 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.786513 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.786513 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.786513 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.786513 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.786513 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.786513 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.786513 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.787018 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.787135 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.787423 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.787810 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.787922 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.788060 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.788364 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.788489 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.788770 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.788926 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.789215 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.789436 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.789754 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.789861 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.790094 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.790239 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.790421 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.790647 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.790785 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.791057 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.791241 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.791384 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.791563 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.791753 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.792022 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.792172 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.792463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.792608 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.792907 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.793053 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.793250 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.793497 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.793644 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.794005 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.794156 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.794308 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.794442 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.794590 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.794848 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.795035 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.795224 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.795360 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.795540 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.795744 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.795888 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.797175 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.797493 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.797776 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.797933 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.797933 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.798198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.798198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.798459 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.798459 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.798738 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.798873 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.799014 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.799337 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.799483 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.799674 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.799864 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.800096 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.800249 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.800516 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.800692 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.800827 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.801037 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.801177 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.801461 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.801597 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.801846 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.802101 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.802304 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.802994 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.802994 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.803707 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.803847 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.804029 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.804180 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.804317 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.804451 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.804625 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.804771 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.804947 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.805109 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.811140 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.812953 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.813097 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.813242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.813405 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.813605 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.813753 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.813891 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.813891 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.813891 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.815080 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.815234 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.815380 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.815542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.815687 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.815830 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.816068 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.816068 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.816347 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.816489 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.816489 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.816743 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.816893 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.817037 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.817173 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.817316 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.817316 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.817316 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.817820 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.817965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.818112 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.818257 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.818399 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.818399 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.818667 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.818849 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.818849 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.818849 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.819472 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.819762 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.819928 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.819928 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.820254 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.820410 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.820567 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.820729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.820879 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.820879 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.821231 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.821394 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.821394 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.821690 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.821847 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.821995 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.822142 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.822142 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.822430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.822593 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.822741 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.822895 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.822895 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.822895 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.822895 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.822895 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.822895 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.823854 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.824098 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.824098 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.824399 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.824548 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.824706 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.824855 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.825002 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.825170 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.825329 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.825485 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.825796 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.825964 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.826166 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.826320 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.826483 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.826727 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.826889 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.827037 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.827193 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.827342 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.828448 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.828720 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.828875 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.829024 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.829173 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.829335 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.829493 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.829649 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.829921 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.830076 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.830232 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.830391 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.830549 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.830713 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.830861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.831016 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.831164 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.831379 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.831542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.831690 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.831845 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.832019 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.832185 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.832421 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.832573 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.832721 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.832880 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.833029 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.833192 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.833339 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.833534 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.833690 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.833855 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.833855 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.834158 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.834158 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.834158 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.834617 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.834787 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.834944 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.835104 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.835260 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.835417 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.835566 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.835748 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.835748 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.836621 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.836824 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.836987 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.837145 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.837293 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.837469 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.837626 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.837783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.837930 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.838086 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.838240 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.838396 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.838554 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.838728 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.838974 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.839134 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.839283 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.839444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.839612 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.839767 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.839943 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.840210 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.840372 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.840534 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.840684 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.840841 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.840841 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.841138 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.841295 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.841498 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.841654 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.841814 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.841962 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.842109 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.842266 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.842423 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.842571 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.842726 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.842874 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.843030 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.843247 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.843915 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.844151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.844304 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.844464 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.844621 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.844852 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.845123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.845274 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.845421 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.845577 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.845577 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.845882 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.846058 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.846338 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.846491 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.846650 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.846808 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.846956 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.847111 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.847259 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.847415 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.847563 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.847721 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.847869 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.848048 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.848204 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.848352 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.848498 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.848670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.848670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.848670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.848670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.848670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.848670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.848670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.849761 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.849909 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.850055 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.850228 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.850228 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.850628 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.850797 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.850953 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.851101 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.851255 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.851421 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.851623 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.851785 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.851945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.852131 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.852289 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.852451 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.852451 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.852745 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.852900 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.853055 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.853212 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.853360 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.853523 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.853523 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.853812 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.853967 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.854198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.854363 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.854513 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.854669 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.854836 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.854985 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.855141 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.855289 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.855444 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.855592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.855738 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.855885 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.856061 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.856223 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.856504 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.856668 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.856816 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.856983 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.857132 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.857278 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.857424 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.857578 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.857726 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.857887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.858034 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.858250 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.858456 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.858621 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.858912 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.859078 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.859458 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.859625 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.859625 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.859927 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.860130 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.860296 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.860472 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.860721 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.860984 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.861148 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.861297 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.861444 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.861663 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.861821 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.861978 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.862136 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.862293 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.862441 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.862615 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.862841 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.862995 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.863157 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.863306 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.863462 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.863618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.863778 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.863941 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.863941 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.863941 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.864538 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.864687 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.864835 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.864997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.865153 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.865301 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.865456 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.865616 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.865776 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.865951 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.866109 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.866259 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.866437 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.866761 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.866917 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.867076 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.867233 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.867391 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.867391 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.867680 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.867838 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.868047 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.868216 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.868372 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.868521 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.868679 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.868847 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.868996 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.869144 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.869299 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.869472 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.869698 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.869871 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.870021 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.870188 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.870188 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.870495 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.870652 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.870900 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.871086 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.871247 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.871409 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.871557 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.871768 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.871931 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.872115 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.872283 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.872583 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.872738 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.872906 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.873105 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.873259 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.873417 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.873564 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.873711 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.873869 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.874024 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.874183 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.874183 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.874183 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.874726 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.874885 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.874885 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.874885 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.875311 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.875475 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.875637 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.875799 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.875948 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.876120 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.876280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.876428 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.876604 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.876785 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.877041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.877202 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.877359 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.877514 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.877676 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.877833 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.877990 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.877990 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.878296 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.878738 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.878904 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.879067 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.879224 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.879379 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.879537 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.879716 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.879910 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.880161 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.880311 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.880471 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.880634 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.880803 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.881066 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.881231 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.881407 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.881566 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.881566 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.881908 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.882070 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.882226 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.882374 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.882546 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.882785 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.882947 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.882947 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.883242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.883416 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.883579 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.883744 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.883908 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.883908 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.884242 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.884398 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.884551 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.884713 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.884876 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.885030 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.885183 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.885336 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.885336 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.885649 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.885804 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.885958 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.886112 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.886265 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.886432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.886597 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.886762 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.886925 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.887229 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.887399 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.887604 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.887783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.887939 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.888120 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.888276 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.888443 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.888612 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.888774 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.888937 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.889101 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.889264 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.889419 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.889419 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.889734 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.889895 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.890610 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.890764 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.890922 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.891088 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.891323 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.891487 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.891644 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.891792 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.892043 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.892213 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.892386 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.892386 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.892675 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.892675 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.893080 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.893236 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.893644 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.893801 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.893959 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.894115 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.894115 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.894115 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.894540 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.894726 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.895440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.895609 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.895768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.895925 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.896124 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.896276 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.896437 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.896667 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.896819 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.896975 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.897132 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.897410 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.897578 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.897735 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.897896 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.898054 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.898203 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.898358 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.898522 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.898678 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.898827 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.898982 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.899139 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.899299 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.899458 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.899615 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.899772 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.899928 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.900129 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.900295 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.900453 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.900609 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.900770 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.900931 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.901089 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.901246 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.901246 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.901643 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.901812 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.902015 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.902184 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.902332 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.902480 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.902626 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.902774 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.902947 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.903180 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.903335 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.903502 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.903660 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.903809 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.903964 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.904229 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.904465 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.904630 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.904630 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.904941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.905103 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.905273 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.905429 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.905628 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.905822 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.905979 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.906143 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.906298 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.906519 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.906680 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.906835 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.906990 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.907159 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.907314 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.907589 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.907759 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.907926 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.908180 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.908350 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.908515 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.908677 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.908677 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.908980 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.909146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.909317 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.909472 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.909634 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.909789 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.909943 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.910120 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.910283 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.910437 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.910599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.910761 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.910924 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.911091 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.911248 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.911409 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.911684 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.911849 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.912026 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.912268 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.912436 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.912592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.912747 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.912902 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.913065 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.913319 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.913482 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.913638 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.913638 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.913940 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.914108 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.914281 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.914472 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.914695 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.914863 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.915029 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.915193 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.915193 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.915498 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.915662 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.915816 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.915971 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.916189 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.916356 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.916519 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.916685 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.916840 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.917003 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.917159 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.917312 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.917467 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.917740 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.917903 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.918072 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.918228 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.918394 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.918550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.918704 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.918877 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.919046 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.919213 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.919375 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.919531 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.919703 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.920407 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.920594 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.920764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.920764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.921066 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.921746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.922013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.922232 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.922401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.922557 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.922726 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.922890 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.923055 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.923211 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.923455 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.923617 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.923773 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.923936 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.924127 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.924308 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.924464 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.924620 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.924781 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.924936 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.925099 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.925256 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.925409 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.925570 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.925733 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.925902 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.926057 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.926258 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.926438 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.926438 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.926741 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.926906 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.927070 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.927231 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.927393 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.927555 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.927728 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.928016 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.928191 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.928357 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.928524 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.928687 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.928856 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.929020 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.929183 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.929338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.929500 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.929655 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.929827 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.929982 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.930137 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.930299 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.930453 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.930618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.930782 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.930942 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.931098 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.931252 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.931252 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.931553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.931717 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.931880 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.932141 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.932141 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.932515 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.932686 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.932856 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.933024 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.933189 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.933344 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.933591 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.933768 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.934547 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.934724 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.934883 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.935039 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.935207 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.935370 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.935525 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.935688 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.935844 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.936018 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.936180 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.936348 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.936512 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.936748 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.936748 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.936748 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.937259 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.937437 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.937595 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.937759 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.937913 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.938210 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.938384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.938540 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.938703 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.938703 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.938933 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.939049 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.939049 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.939265 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.939399 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.939399 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.939628 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.939744 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.939744 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.939966 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.939966 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.952330 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.952330 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.952711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.952882 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.953039 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.953180 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.953180 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.953363 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.953461 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.953461 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.953635 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.953750 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.953840 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.953927 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.953927 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.954083 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.954185 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.954275 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.954351 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.954351 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.954351 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.954550 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.954781 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.954889 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.955191 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.955292 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.955380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.955380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.955558 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.955655 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.955751 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.955839 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.955839 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.956080 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.956182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.956272 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.956359 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.956447 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.956543 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.956640 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.956728 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.956815 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.956815 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.956981 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.957083 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.957172 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.957283 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.957384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.957474 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.957561 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.957657 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.957746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.957746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.957910 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.958004 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.958099 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.958197 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.958274 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.958274 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.958423 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.958423 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.958589 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.958685 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.958762 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.958855 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.958944 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.959031 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.959323 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.959421 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.959497 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.959583 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.959583 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.959739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.959835 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.959932 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.960038 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.960159 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.960301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.960395 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.960494 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.960593 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.960689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.960778 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.960866 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.960967 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.961057 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.961151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.961239 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.961326 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.961413 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.961413 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.961594 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.961690 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.961803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.961909 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.961985 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.961985 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.962146 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.962241 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.962334 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.962411 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.962497 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.962724 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.962829 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.962918 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.963005 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.963092 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.963194 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.963334 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.963432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.963531 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.963620 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.963708 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.963815 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.963904 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.964038 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.964132 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.964223 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.964310 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.964411 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.964507 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.964603 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.964698 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.964810 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.964909 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.964998 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.965085 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.965181 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.965281 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.965377 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.965483 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.965580 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.965678 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.965775 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.965864 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.965951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.966047 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.966143 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.966232 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.966327 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.966423 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.966519 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.966615 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.966704 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.966786 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.966867 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.966968 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.967065 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.967155 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.967231 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.967305 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 15:19:17.967391 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.967391 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.967391 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.967391 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.967391 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.967391 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.967391 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.967391 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.968768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.968768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.968768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.968768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.968768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.968768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.968768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.968768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.969727 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.969727 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.969727 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.969727 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.969727 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.970125 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.970125 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:19:17.970335 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 15:19:18.025132 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO dbcounter [None req-c7cdf19f-889d-491d-b962-0720706b0c5c None None] Registered counter for database nova_api Sep 23 15:19:18.033456 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO dbcounter [None req-94ba91fa-0200-480f-8e3f-ccc89d23ebf3 None None] Registered counter for database nova_api Sep 23 15:19:18.046093 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_db.sqlalchemy.engines [None req-c7cdf19f-889d-491d-b962-0720706b0c5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:19:18.053867 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writer thread running {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:19:18.054580 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_db.sqlalchemy.engines [None req-94ba91fa-0200-480f-8e3f-ccc89d23ebf3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:19:18.061174 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writer thread running {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:19:18.112616 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.context [None req-c7cdf19f-889d-491d-b962-0720706b0c5c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4716d4cc-8887-47c1-8c33-3edcb99d9da0(cell1) {{(pid=121448) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 15:19:18.116735 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c7cdf19f-889d-491d-b962-0720706b0c5c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:18.117216 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c7cdf19f-889d-491d-b962-0720706b0c5c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:18.118735 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.context [None req-94ba91fa-0200-480f-8e3f-ccc89d23ebf3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4716d4cc-8887-47c1-8c33-3edcb99d9da0(cell1) {{(pid=121450) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 15:19:18.119224 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c7cdf19f-889d-491d-b962-0720706b0c5c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:18.120067 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c7cdf19f-889d-491d-b962-0720706b0c5c None None] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:18.120459 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c7cdf19f-889d-491d-b962-0720706b0c5c None None] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:18.122524 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c7cdf19f-889d-491d-b962-0720706b0c5c None None] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:18.122775 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-94ba91fa-0200-480f-8e3f-ccc89d23ebf3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:18.123259 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-94ba91fa-0200-480f-8e3f-ccc89d23ebf3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:18.124658 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO dbcounter [None req-c7cdf19f-889d-491d-b962-0720706b0c5c None None] Registered counter for database nova_cell0 Sep 23 15:19:18.125171 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-94ba91fa-0200-480f-8e3f-ccc89d23ebf3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:18.125930 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-94ba91fa-0200-480f-8e3f-ccc89d23ebf3 None None] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:18.126382 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-94ba91fa-0200-480f-8e3f-ccc89d23ebf3 None None] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:18.128438 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-94ba91fa-0200-480f-8e3f-ccc89d23ebf3 None None] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:18.128868 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO dbcounter [None req-c7cdf19f-889d-491d-b962-0720706b0c5c None None] Registered counter for database nova_cell1 Sep 23 15:19:18.130519 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO dbcounter [None req-94ba91fa-0200-480f-8e3f-ccc89d23ebf3 None None] Registered counter for database nova_cell0 Sep 23 15:19:18.134655 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO dbcounter [None req-94ba91fa-0200-480f-8e3f-ccc89d23ebf3 None None] Registered counter for database nova_cell1 Sep 23 15:19:18.136296 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_db.sqlalchemy.engines [None req-c7cdf19f-889d-491d-b962-0720706b0c5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:19:18.139110 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_db.sqlalchemy.engines [None req-c7cdf19f-889d-491d-b962-0720706b0c5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:19:18.142893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_db.sqlalchemy.engines [None req-94ba91fa-0200-480f-8e3f-ccc89d23ebf3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:19:18.145732 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_db.sqlalchemy.engines [None req-94ba91fa-0200-480f-8e3f-ccc89d23ebf3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:19:18.146903 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writer thread running {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:19:18.149087 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writer thread running {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:19:18.150942 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writer thread running {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:19:18.153683 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writer thread running {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:19:18.301840 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO dbcounter [None req-c7cdf19f-889d-491d-b962-0720706b0c5c None None] Registered counter for database nova_cell0 Sep 23 15:19:18.302690 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO dbcounter [None req-94ba91fa-0200-480f-8e3f-ccc89d23ebf3 None None] Registered counter for database nova_cell0 Sep 23 15:19:18.309590 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_db.sqlalchemy.engines [None req-c7cdf19f-889d-491d-b962-0720706b0c5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:19:18.314187 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_db.sqlalchemy.engines [None req-94ba91fa-0200-480f-8e3f-ccc89d23ebf3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:19:18.315155 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writer thread running {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:19:18.318866 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writer thread running {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:19:18.643747 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: WARNING keystonemiddleware.auth_token [None req-94ba91fa-0200-480f-8e3f-ccc89d23ebf3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 15:19:18.643980 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: WARNING keystonemiddleware.auth_token [None req-c7cdf19f-889d-491d-b962-0720706b0c5c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 15:19:18.651354 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: WARNING keystonemiddleware.auth_token [None req-c7cdf19f-889d-491d-b962-0720706b0c5c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 15:19:18.651752 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: WARNING keystonemiddleware.auth_token [None req-94ba91fa-0200-480f-8e3f-ccc89d23ebf3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 15:19:19.006538 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: WARNING keystonemiddleware.auth_token [None req-c7cdf19f-889d-491d-b962-0720706b0c5c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 15:19:19.010662 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: WARNING keystonemiddleware.auth_token [None req-94ba91fa-0200-480f-8e3f-ccc89d23ebf3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 15:19:19.012652 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: WARNING keystonemiddleware.auth_token [None req-c7cdf19f-889d-491d-b962-0720706b0c5c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 15:19:19.017421 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: WARNING keystonemiddleware.auth_token [None req-94ba91fa-0200-480f-8e3f-ccc89d23ebf3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 15:19:19.019269 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561cccaf19c0 pid: 121448 (default app) Sep 23 15:19:19.023030 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561cccaf19c0 pid: 121450 (default app) Sep 23 15:19:57.965710 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_api:SELECT=3 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:19:57.968037 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell0:SELECT=3 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:19:57.968906 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=3 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:19:57.969653 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell0:SELECT=3 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:19:59.297871 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_api:SELECT=3 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:19:59.299668 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell0:SELECT=3 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:19:59.300424 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=3 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:19:59.302234 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell0:SELECT=3 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:19:59.352580 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-63a1a877-6074-42ff-8aae-efa1346dd752 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Action: 'create', calling method: .version_select at 0x7f82dcaca430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-485221809"}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:20:00.050932 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-775fd9cd-8ea2-42e0-aaa9-68c59aa4a15d tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] Action: 'create', calling method: .version_select at 0x7f82dcad2700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-308009576", "metadata": {"Type": "work"}}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:20:00.057376 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-775fd9cd-8ea2-42e0-aaa9-68c59aa4a15d tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] Request method failure captured: Sep 23 15:20:00.057376 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 23 15:20:00.057376 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:20:00.057376 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:20:00.057376 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:20:00.057376 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 121 Sep 23 15:20:00.057376 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:20:00.057376 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:20:00.057376 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:20:00.057376 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:20:00.057376 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLc6fgAQhxcjIj6NvjQGdgY5QT_c9Rc-1D-Y5dsBczb3ZoNHR3G1yrfQyuXMhqyKbR6VmKQuuyVWSu_0XplH2PoEuDYHRQHUX3yjsUaYwHopCoGPkG-wWw7X1sjulRQ4wSudJlAlOcXNzUkxeUT2rQuXDYkOU2wy0Q7ga0BKXQ7f0IPY Sep 23 15:20:00.057376 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:20:00.057376 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:20:00.057376 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:20:00.057376 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:20:00.057376 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:20:00.057376 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:20:00.057376 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: 700da9a5171446dfb55095c96caa714f Sep 23 15:20:00.057376 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-VolumesNegativeTest-170837931 Sep 23 15:20:00.057376 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:20:00.057376 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:20:00.058772 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/700da9a5171446dfb55095c96caa714f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/700da9a5171446dfb55095c96caa714f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_700da9a5171446dfb55095c96caa714f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/700da9a5171446dfb55095c96caa714f"}]}] Sep 23 15:20:00.058772 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-VolumesNegativeTest-170837931 Sep 23 15:20:00.058772 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: 700da9a5171446dfb55095c96caa714f Sep 23 15:20:00.058772 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-VolumesNegativeTest-170837931 Sep 23 15:20:00.058772 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-VolumesNegativeTest-170837931-project Sep 23 15:20:00.058772 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:20:00.058772 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:20:00.058772 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 473a152c83444c87aea51c0c1569b249 Sep 23 15:20:00.058772 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-VolumesNegativeTest-170837931-project Sep 23 15:20:00.058772 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Sep 23 15:20:00.058772 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-308009576", "metadata": {"Type": "work"}}} Sep 23 15:20:00.058772 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: Sep 23 15:20:00.058772 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 23 15:20:00.059592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-308009576', 'metadata': {'Type': 'work'}}}} Sep 23 15:20:00.059592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:20:00.059592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:00.059592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 15:20:00.059592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 15:20:00.059592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 15:20:00.059592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise error Sep 23 15:20:00.059592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 23 15:20:00.059592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.059592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 23 15:20:00.059592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 23 15:20:00.059592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.059592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 23 15:20:00.059592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi '#$%' Sep 23 15:20:00.059592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.059592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:00.059592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.059592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:00.059592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:20:00.059592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:20:00.059592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:20:00.059592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:20:00.061091 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 15:20:00.061091 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 15:20:00.061091 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:20:00.061091 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:20:00.061091 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 15:20:00.061091 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 15:20:00.061091 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 15:20:00.061091 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 15:20:00.061091 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 15:20:00.061091 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 15:20:00.061091 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 23 15:20:00.061091 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.061091 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:00.061091 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.061091 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:00.061091 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:20:00.061091 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:20:00.061091 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 15:20:00.061091 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 15:20:00.062318 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 23 15:20:00.062318 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.064034 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-775fd9cd-8ea2-42e0-aaa9-68c59aa4a15d tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:20:00.065205 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-775fd9cd-8ea2-42e0-aaa9-68c59aa4a15d tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.780336 Sep 23 15:20:00.065776 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 1/1] 10.222.0.55 () {60 vars in 1156 bytes} [Fri Sep 23 15:19:59 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 782 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 15:20:00.078441 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-947b7d5c-5ffc-4538-8516-bcb5dd49dfb5 tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] Action: 'create', calling method: .version_select at 0x7f82dcad2790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-79987285", "metadata": {"Type": "work"}}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:20:00.120223 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-947b7d5c-5ffc-4538-8516-bcb5dd49dfb5 tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] Request method failure captured: Sep 23 15:20:00.120223 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 23 15:20:00.120223 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:20:00.120223 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:20:00.120223 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:20:00.120223 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 118 Sep 23 15:20:00.120223 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:20:00.120223 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:20:00.120223 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:20:00.120223 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:20:00.120223 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLc6fgAQhxcjIj6NvjQGdgY5QT_c9Rc-1D-Y5dsBczb3ZoNHR3G1yrfQyuXMhqyKbR6VmKQuuyVWSu_0XplH2PoEuDYHRQHUX3yjsUaYwHopCoGPkG-wWw7X1sjulRQ4wSudJlAlOcXNzUkxeUT2rQuXDYkOU2wy0Q7ga0BKXQ7f0IPY Sep 23 15:20:00.120223 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:20:00.120223 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:20:00.120223 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:20:00.120223 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:20:00.120223 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:20:00.120223 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:20:00.120223 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: 700da9a5171446dfb55095c96caa714f Sep 23 15:20:00.120223 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-VolumesNegativeTest-170837931 Sep 23 15:20:00.120223 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:20:00.120223 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:20:00.121901 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/700da9a5171446dfb55095c96caa714f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/700da9a5171446dfb55095c96caa714f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_700da9a5171446dfb55095c96caa714f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/700da9a5171446dfb55095c96caa714f"}]}] Sep 23 15:20:00.121901 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-VolumesNegativeTest-170837931 Sep 23 15:20:00.121901 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: 700da9a5171446dfb55095c96caa714f Sep 23 15:20:00.121901 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-VolumesNegativeTest-170837931 Sep 23 15:20:00.121901 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-VolumesNegativeTest-170837931-project Sep 23 15:20:00.121901 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:20:00.121901 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:20:00.121901 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 473a152c83444c87aea51c0c1569b249 Sep 23 15:20:00.121901 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-VolumesNegativeTest-170837931-project Sep 23 15:20:00.121901 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Sep 23 15:20:00.121901 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-79987285", "metadata": {"Type": "work"}}} Sep 23 15:20:00.121901 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: Sep 23 15:20:00.121901 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 23 15:20:00.122941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-79987285', 'metadata': {'Type': 'work'}}}} Sep 23 15:20:00.122941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:20:00.122941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:00.122941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 15:20:00.122941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 15:20:00.122941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 15:20:00.122941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise error Sep 23 15:20:00.122941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 23 15:20:00.122941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.122941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 23 15:20:00.122941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 23 15:20:00.122941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.122941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 23 15:20:00.122941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi '0' Sep 23 15:20:00.122941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.122941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:00.122941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.122941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:00.122941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:20:00.122941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:20:00.122941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:20:00.122941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:20:00.124805 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 15:20:00.124805 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 15:20:00.124805 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:20:00.124805 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:20:00.124805 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 15:20:00.124805 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 15:20:00.124805 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 15:20:00.124805 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 15:20:00.124805 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 15:20:00.124805 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 15:20:00.124805 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 23 15:20:00.124805 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.124805 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:00.124805 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.124805 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:00.124805 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:20:00.124805 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:20:00.124805 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 15:20:00.124805 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 15:20:00.127150 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 23 15:20:00.127150 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.127150 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-947b7d5c-5ffc-4538-8516-bcb5dd49dfb5 tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:20:00.127150 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-947b7d5c-5ffc-4538-8516-bcb5dd49dfb5 tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020180 Sep 23 15:20:00.127150 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 2/2] 10.222.0.55 () {60 vars in 1156 bytes} [Fri Sep 23 15:20:00 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 15:20:00.134736 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-7d774d91-3261-4e02-ae6f-da04528ef096 tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] Action: 'create', calling method: .version_select at 0x7f82dc98d310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-161621812", "metadata": {"Type": "work"}}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:20:00.143346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-7d774d91-3261-4e02-ae6f-da04528ef096 tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] Request method failure captured: Sep 23 15:20:00.143346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 23 15:20:00.143346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:20:00.143346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:20:00.143346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:20:00.143346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 118 Sep 23 15:20:00.143346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:20:00.143346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:20:00.143346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:20:00.143346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:20:00.143346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLc6fgAQhxcjIj6NvjQGdgY5QT_c9Rc-1D-Y5dsBczb3ZoNHR3G1yrfQyuXMhqyKbR6VmKQuuyVWSu_0XplH2PoEuDYHRQHUX3yjsUaYwHopCoGPkG-wWw7X1sjulRQ4wSudJlAlOcXNzUkxeUT2rQuXDYkOU2wy0Q7ga0BKXQ7f0IPY Sep 23 15:20:00.143346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:20:00.143346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:20:00.143346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:20:00.143346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:20:00.143346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:20:00.143346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:20:00.143346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: 700da9a5171446dfb55095c96caa714f Sep 23 15:20:00.143346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-VolumesNegativeTest-170837931 Sep 23 15:20:00.143346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:20:00.143346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:20:00.144689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/700da9a5171446dfb55095c96caa714f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/700da9a5171446dfb55095c96caa714f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_700da9a5171446dfb55095c96caa714f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/700da9a5171446dfb55095c96caa714f"}]}] Sep 23 15:20:00.144689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-VolumesNegativeTest-170837931 Sep 23 15:20:00.144689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: 700da9a5171446dfb55095c96caa714f Sep 23 15:20:00.144689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-VolumesNegativeTest-170837931 Sep 23 15:20:00.144689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-VolumesNegativeTest-170837931-project Sep 23 15:20:00.144689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:20:00.144689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:20:00.144689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 473a152c83444c87aea51c0c1569b249 Sep 23 15:20:00.144689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-VolumesNegativeTest-170837931-project Sep 23 15:20:00.144689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Sep 23 15:20:00.144689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-161621812", "metadata": {"Type": "work"}}} Sep 23 15:20:00.144689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: Sep 23 15:20:00.144689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 23 15:20:00.145488 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-161621812', 'metadata': {'Type': 'work'}}}} Sep 23 15:20:00.145488 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:20:00.145488 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:00.145488 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 15:20:00.145488 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 15:20:00.145488 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 15:20:00.145488 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise error Sep 23 15:20:00.145488 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 23 15:20:00.145488 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.145488 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 23 15:20:00.145488 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 23 15:20:00.145488 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.145488 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 23 15:20:00.145488 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi '' Sep 23 15:20:00.145488 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.145488 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:00.145488 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.145488 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:00.145488 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:20:00.145488 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:20:00.145488 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:20:00.145488 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:20:00.147553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 15:20:00.147553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 15:20:00.147553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:20:00.147553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:20:00.147553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 15:20:00.147553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 15:20:00.147553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 15:20:00.147553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 15:20:00.147553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 15:20:00.147553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 15:20:00.147553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 23 15:20:00.147553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.147553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:00.147553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.147553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:00.147553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:20:00.147553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:20:00.147553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 15:20:00.147553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 15:20:00.148732 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 23 15:20:00.148732 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.148732 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-7d774d91-3261-4e02-ae6f-da04528ef096 tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:20:00.148732 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-7d774d91-3261-4e02-ae6f-da04528ef096 tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020064 Sep 23 15:20:00.148732 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 3/3] 10.222.0.55 () {60 vars in 1156 bytes} [Fri Sep 23 15:20:00 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 15:20:00.163740 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b0db368f-b056-4077-9ea4-e12110feddba tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] Calling method '.version_select at 0x7f82dc98dd30>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:00.753689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-b0db368f-b056-4077-9ea4-e12110feddba tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] HTTP exception thrown: Volume tempest-invalid-835173605 could not be found. Sep 23 15:20:00.758387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b0db368f-b056-4077-9ea4-e12110feddba tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] Request method failure captured: Sep 23 15:20:00.758387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-835173605 HTTP/1.1 Sep 23 15:20:00.758387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:20:00.758387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:20:00.758387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:20:00.758387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:20:00.758387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:20:00.758387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:20:00.758387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:20:00.758387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:20:00.758387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLc6fgAQhxcjIj6NvjQGdgY5QT_c9Rc-1D-Y5dsBczb3ZoNHR3G1yrfQyuXMhqyKbR6VmKQuuyVWSu_0XplH2PoEuDYHRQHUX3yjsUaYwHopCoGPkG-wWw7X1sjulRQ4wSudJlAlOcXNzUkxeUT2rQuXDYkOU2wy0Q7ga0BKXQ7f0IPY Sep 23 15:20:00.758387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:20:00.758387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:20:00.758387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:20:00.758387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:20:00.758387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:20:00.758387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:20:00.758387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: 700da9a5171446dfb55095c96caa714f Sep 23 15:20:00.758387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-VolumesNegativeTest-170837931 Sep 23 15:20:00.758387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:20:00.758387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:20:00.759594 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/700da9a5171446dfb55095c96caa714f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/700da9a5171446dfb55095c96caa714f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_700da9a5171446dfb55095c96caa714f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/700da9a5171446dfb55095c96caa714f"}]}] Sep 23 15:20:00.759594 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-VolumesNegativeTest-170837931 Sep 23 15:20:00.759594 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: 700da9a5171446dfb55095c96caa714f Sep 23 15:20:00.759594 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-VolumesNegativeTest-170837931 Sep 23 15:20:00.759594 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-VolumesNegativeTest-170837931-project Sep 23 15:20:00.759594 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:20:00.759594 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:20:00.759594 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 473a152c83444c87aea51c0c1569b249 Sep 23 15:20:00.759594 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-VolumesNegativeTest-170837931-project Sep 23 15:20:00.759594 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: Sep 23 15:20:00.759594 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Volume tempest-invalid-835173605 could not be found. Sep 23 15:20:00.759594 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': 'tempest-invalid-835173605'} Sep 23 15:20:00.759594 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:20:00.760356 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:00.760356 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:20:00.760356 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:20:00.760356 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 15:20:00.760356 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 15:20:00.760356 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 15:20:00.760356 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 15:20:00.760356 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 15:20:00.760356 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 15:20:00.760356 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 15:20:00.760356 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 15:20:00.760356 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:20:00.760356 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:20:00.760356 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:20:00.760356 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:20:00.760356 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-835173605 could not be found. (HTTP 404) (Request-ID: req-4141ae58-73c4-4605-9b6d-ff9a841aeccb) Sep 23 15:20:00.760356 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.760356 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:00.760356 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.761493 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:00.761493 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 23 15:20:00.761493 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 23 15:20:00.761493 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 15:20:00.761493 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 15:20:00.761493 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 15:20:00.761493 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 15:20:00.761493 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 15:20:00.761493 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 15:20:00.761493 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:20:00.761493 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:20:00.761493 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 15:20:00.761493 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 15:20:00.761493 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 15:20:00.761493 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 15:20:00.761493 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 15:20:00.761493 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 15:20:00.761493 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 15:20:00.761493 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 15:20:00.764020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:20:00.764020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:20:00.764020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:20:00.764020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:20:00.764020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-835173605 could not be found. Sep 23 15:20:00.764020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.764020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:00.764020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.764020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:00.764020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:20:00.764020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:20:00.764020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:20:00.764020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:20:00.764020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 15:20:00.764020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 15:20:00.764020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:20:00.764020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:20:00.764020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 23 15:20:00.764020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:20:00.764020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-835173605 could not be found. Sep 23 15:20:00.772260 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.772260 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:00.772260 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.772260 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:00.772260 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:20:00.772260 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:20:00.772260 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:20:00.772260 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:20:00.772260 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-835173605 could not be found. Sep 23 15:20:00.772260 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.772260 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b0db368f-b056-4077-9ea4-e12110feddba tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] Returning 404 to user: Volume tempest-invalid-835173605 could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:20:00.772260 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-b0db368f-b056-4077-9ea4-e12110feddba tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/tempest-invalid-835173605" status: 404 len: 98 microversion: 2.1 time: 0.602802 Sep 23 15:20:00.772260 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 4/4] 10.222.0.55 () {58 vars in 1215 bytes} [Fri Sep 23 15:20:00 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-835173605 => generated 98 bytes in 609 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 15:20:00.777557 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-81310b6f-319a-463a-8b4a-c301e1072f80 tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007951 Sep 23 15:20:00.783239 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 5/5] 10.222.0.55 () {58 vars in 1140 bytes} [Fri Sep 23 15:20:00 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 23 15:20:00.788735 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-520b32c2-9059-4ec6-ad17-fcc10a114163 tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004438 Sep 23 15:20:00.793382 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 6/6] 10.222.0.55 () {58 vars in 1137 bytes} [Fri Sep 23 15:20:00 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 23 15:20:00.800412 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-0905ea7b-04d8-48f0-beab-1b5fc14e7382 tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] Calling method '.version_select at 0x7f82dc8bc430>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:01.062666 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-0905ea7b-04d8-48f0-beab-1b5fc14e7382 tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] HTTP exception thrown: Volume 6780d348-bf60-4caa-bc6c-d17d644f5c33 could not be found. Sep 23 15:20:01.070433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-0905ea7b-04d8-48f0-beab-1b5fc14e7382 tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] Request method failure captured: Sep 23 15:20:01.070433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: DELETE /compute/v2.1/os-volumes/6780d348-bf60-4caa-bc6c-d17d644f5c33 HTTP/1.1 Sep 23 15:20:01.070433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:20:01.070433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:20:01.070433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:20:01.070433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:20:01.070433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:20:01.070433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:20:01.070433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:20:01.070433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:20:01.070433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLc6fgAQhxcjIj6NvjQGdgY5QT_c9Rc-1D-Y5dsBczb3ZoNHR3G1yrfQyuXMhqyKbR6VmKQuuyVWSu_0XplH2PoEuDYHRQHUX3yjsUaYwHopCoGPkG-wWw7X1sjulRQ4wSudJlAlOcXNzUkxeUT2rQuXDYkOU2wy0Q7ga0BKXQ7f0IPY Sep 23 15:20:01.070433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:20:01.070433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:20:01.070433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:20:01.070433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:20:01.070433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:20:01.070433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:20:01.070433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: 700da9a5171446dfb55095c96caa714f Sep 23 15:20:01.070433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-VolumesNegativeTest-170837931 Sep 23 15:20:01.070433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:20:01.070433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:20:01.071750 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/700da9a5171446dfb55095c96caa714f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/700da9a5171446dfb55095c96caa714f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_700da9a5171446dfb55095c96caa714f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/700da9a5171446dfb55095c96caa714f"}]}] Sep 23 15:20:01.071750 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-VolumesNegativeTest-170837931 Sep 23 15:20:01.071750 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: 700da9a5171446dfb55095c96caa714f Sep 23 15:20:01.071750 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-VolumesNegativeTest-170837931 Sep 23 15:20:01.071750 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-VolumesNegativeTest-170837931-project Sep 23 15:20:01.071750 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:20:01.071750 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:20:01.071750 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 473a152c83444c87aea51c0c1569b249 Sep 23 15:20:01.071750 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-VolumesNegativeTest-170837931-project Sep 23 15:20:01.071750 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: Sep 23 15:20:01.071750 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Volume 6780d348-bf60-4caa-bc6c-d17d644f5c33 could not be found. Sep 23 15:20:01.071750 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '6780d348-bf60-4caa-bc6c-d17d644f5c33'} Sep 23 15:20:01.071750 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:20:01.072622 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:01.072622 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:20:01.072622 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:20:01.072622 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 15:20:01.072622 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 15:20:01.072622 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 15:20:01.072622 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 15:20:01.072622 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 15:20:01.072622 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 15:20:01.072622 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 15:20:01.072622 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 15:20:01.072622 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:20:01.072622 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:20:01.072622 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:20:01.072622 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:20:01.072622 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6780d348-bf60-4caa-bc6c-d17d644f5c33 could not be found. (HTTP 404) (Request-ID: req-fc62f5c4-8fa5-4ae9-a364-cdb284aa4be9) Sep 23 15:20:01.072622 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:01.072622 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:01.072622 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:01.073760 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:01.073760 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 23 15:20:01.073760 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 23 15:20:01.073760 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 15:20:01.073760 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 15:20:01.073760 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 15:20:01.073760 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 15:20:01.073760 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 15:20:01.073760 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 15:20:01.073760 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:20:01.073760 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:20:01.073760 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 15:20:01.073760 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 15:20:01.073760 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 15:20:01.073760 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 15:20:01.073760 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 15:20:01.073760 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 15:20:01.073760 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 15:20:01.073760 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 15:20:01.074833 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:20:01.074833 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:20:01.074833 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:20:01.074833 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:20:01.074833 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6780d348-bf60-4caa-bc6c-d17d644f5c33 could not be found. Sep 23 15:20:01.074833 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:01.074833 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:01.074833 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:01.074833 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:01.074833 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:20:01.074833 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:20:01.074833 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:20:01.074833 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:20:01.074833 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 15:20:01.074833 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 15:20:01.074833 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:20:01.074833 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:20:01.074833 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 23 15:20:01.074833 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:20:01.075904 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6780d348-bf60-4caa-bc6c-d17d644f5c33 could not be found. Sep 23 15:20:01.075904 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:01.075904 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:01.075904 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:01.075904 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:01.075904 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:20:01.075904 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:20:01.075904 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:20:01.075904 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:20:01.075904 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6780d348-bf60-4caa-bc6c-d17d644f5c33 could not be found. Sep 23 15:20:01.075904 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:01.082800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-0905ea7b-04d8-48f0-beab-1b5fc14e7382 tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] Returning 404 to user: Volume 6780d348-bf60-4caa-bc6c-d17d644f5c33 could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:20:01.087726 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-0905ea7b-04d8-48f0-beab-1b5fc14e7382 tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/6780d348-bf60-4caa-bc6c-d17d644f5c33" status: 404 len: 109 microversion: 2.1 time: 0.292351 Sep 23 15:20:01.088496 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 7/7] 10.222.0.55 () {58 vars in 1248 bytes} [Fri Sep 23 15:20:00 2022] DELETE /compute/v2.1/os-volumes/6780d348-bf60-4caa-bc6c-d17d644f5c33 => generated 109 bytes in 295 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:20:01.105668 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-808cb4da-d5b1-4b26-a4f0-f381cff5a52a tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] Calling method '.version_select at 0x7f82dc90ed30>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:01.333662 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-808cb4da-d5b1-4b26-a4f0-f381cff5a52a tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] HTTP exception thrown: Volume fd5ce2cc-8083-4923-9897-efac091f89d2 could not be found. Sep 23 15:20:01.336008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-808cb4da-d5b1-4b26-a4f0-f381cff5a52a tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] Request method failure captured: Sep 23 15:20:01.336008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: GET /compute/v2.1/os-volumes/fd5ce2cc-8083-4923-9897-efac091f89d2 HTTP/1.1 Sep 23 15:20:01.336008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:20:01.336008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:20:01.336008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:20:01.336008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:20:01.336008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:20:01.336008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:20:01.336008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:20:01.336008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:20:01.336008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLc6fgAQhxcjIj6NvjQGdgY5QT_c9Rc-1D-Y5dsBczb3ZoNHR3G1yrfQyuXMhqyKbR6VmKQuuyVWSu_0XplH2PoEuDYHRQHUX3yjsUaYwHopCoGPkG-wWw7X1sjulRQ4wSudJlAlOcXNzUkxeUT2rQuXDYkOU2wy0Q7ga0BKXQ7f0IPY Sep 23 15:20:01.336008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:20:01.336008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:20:01.336008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:20:01.336008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:20:01.336008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:20:01.336008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:20:01.336008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: 700da9a5171446dfb55095c96caa714f Sep 23 15:20:01.336008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-VolumesNegativeTest-170837931 Sep 23 15:20:01.336008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:20:01.336008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:20:01.337143 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/700da9a5171446dfb55095c96caa714f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/700da9a5171446dfb55095c96caa714f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_700da9a5171446dfb55095c96caa714f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/700da9a5171446dfb55095c96caa714f"}]}] Sep 23 15:20:01.337143 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-VolumesNegativeTest-170837931 Sep 23 15:20:01.337143 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: 700da9a5171446dfb55095c96caa714f Sep 23 15:20:01.337143 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-VolumesNegativeTest-170837931 Sep 23 15:20:01.337143 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-VolumesNegativeTest-170837931-project Sep 23 15:20:01.337143 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:20:01.337143 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:20:01.337143 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 473a152c83444c87aea51c0c1569b249 Sep 23 15:20:01.337143 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-VolumesNegativeTest-170837931-project Sep 23 15:20:01.337143 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: Sep 23 15:20:01.337143 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Volume fd5ce2cc-8083-4923-9897-efac091f89d2 could not be found. Sep 23 15:20:01.337143 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': 'fd5ce2cc-8083-4923-9897-efac091f89d2'} Sep 23 15:20:01.337143 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:20:01.337869 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:01.337869 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:20:01.337869 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:20:01.337869 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 15:20:01.337869 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 15:20:01.337869 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 15:20:01.337869 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 15:20:01.337869 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 15:20:01.337869 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 15:20:01.337869 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 15:20:01.337869 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 15:20:01.337869 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:20:01.337869 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:20:01.337869 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:20:01.337869 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:20:01.337869 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fd5ce2cc-8083-4923-9897-efac091f89d2 could not be found. (HTTP 404) (Request-ID: req-23b6e64d-9011-477b-941b-f5b4af18da52) Sep 23 15:20:01.337869 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:01.337869 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:01.337869 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:01.338923 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:01.338923 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 23 15:20:01.338923 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 23 15:20:01.338923 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 15:20:01.338923 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 15:20:01.338923 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 15:20:01.338923 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 15:20:01.338923 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 15:20:01.338923 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 15:20:01.338923 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:20:01.338923 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:20:01.338923 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 15:20:01.338923 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 15:20:01.338923 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 15:20:01.338923 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 15:20:01.338923 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 15:20:01.338923 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 15:20:01.338923 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 15:20:01.338923 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 15:20:01.339893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:20:01.339893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:20:01.339893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:20:01.339893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:20:01.339893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fd5ce2cc-8083-4923-9897-efac091f89d2 could not be found. Sep 23 15:20:01.339893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:01.339893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:01.339893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:01.339893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:01.339893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:20:01.339893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:20:01.339893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:20:01.339893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:20:01.339893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 15:20:01.339893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 15:20:01.339893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:20:01.339893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:20:01.339893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 23 15:20:01.339893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:20:01.354858 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fd5ce2cc-8083-4923-9897-efac091f89d2 could not be found. Sep 23 15:20:01.354858 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:01.354858 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:01.354858 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:01.354858 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:01.354858 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:20:01.354858 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:20:01.354858 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:20:01.354858 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:20:01.354858 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fd5ce2cc-8083-4923-9897-efac091f89d2 could not be found. Sep 23 15:20:01.354858 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:01.354858 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-808cb4da-d5b1-4b26-a4f0-f381cff5a52a tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] Returning 404 to user: Volume fd5ce2cc-8083-4923-9897-efac091f89d2 could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:20:01.354858 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-808cb4da-d5b1-4b26-a4f0-f381cff5a52a tempest-VolumesNegativeTest-170837931 tempest-VolumesNegativeTest-170837931-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/fd5ce2cc-8083-4923-9897-efac091f89d2" status: 404 len: 109 microversion: 2.1 time: 0.247334 Sep 23 15:20:01.354858 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 8/8] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Sep 23 15:20:01 2022] GET /compute/v2.1/os-volumes/fd5ce2cc-8083-4923-9897-efac091f89d2 => generated 109 bytes in 250 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:20:01.566630 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-63a1a877-6074-42ff-8aae-efa1346dd752 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.607210 Sep 23 15:20:01.567905 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 1/9] 10.222.0.55 () {60 vars in 1155 bytes} [Fri Sep 23 15:19:57 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3611 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 23 15:20:01.583614 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-2ff7aaa5-3d3c-4394-8b34-7f369321dc5a tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Calling method '.version_select at 0x7f82dc98d4c0>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:01.643543 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-2ff7aaa5-3d3c-4394-8b34-7f369321dc5a tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/b7455d19-23f8-4f30-872a-184462254429" status: 200 len: 344 microversion: 2.1 time: 0.063942 Sep 23 15:20:01.644479 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 9/10] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Sep 23 15:20:01 2022] GET /compute/v2.1/os-volumes/b7455d19-23f8-4f30-872a-184462254429 => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:20:02.665009 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-fcb2e0a2-6ef8-4513-9fff-26a2d022a26c tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Calling method '.version_select at 0x7f82dc99f310>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:02.802427 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-fcb2e0a2-6ef8-4513-9fff-26a2d022a26c tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/b7455d19-23f8-4f30-872a-184462254429" status: 200 len: 344 microversion: 2.1 time: 0.138969 Sep 23 15:20:02.802427 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 2/11] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Sep 23 15:20:02 2022] GET /compute/v2.1/os-volumes/b7455d19-23f8-4f30-872a-184462254429 => generated 344 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:20:03.809086 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a542ee63-180c-4c69-8903-f03888ddd338 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Calling method '.version_select at 0x7f82dc90ea60>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:03.879036 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-a542ee63-180c-4c69-8903-f03888ddd338 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/b7455d19-23f8-4f30-872a-184462254429" status: 200 len: 345 microversion: 2.1 time: 0.074088 Sep 23 15:20:03.879662 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 10/12] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Sep 23 15:20:03 2022] GET /compute/v2.1/os-volumes/b7455d19-23f8-4f30-872a-184462254429 => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:20:03.895022 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-1ead9b19-9d4e-43db-bec7-4f04ba12b19e tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Action: 'create', calling method: .version_select at 0x7f82dc99f940>, body: {"snapshot": {"volume_id": "b7455d19-23f8-4f30-872a-184462254429", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-882128822"}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:20:04.797861 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-1ead9b19-9d4e-43db-bec7-4f04ba12b19e tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] 10.222.0.55 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.908731 Sep 23 15:20:04.804338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 3/13] 10.222.0.55 () {60 vars in 1162 bytes} [Fri Sep 23 15:20:03 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:20:04.810507 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-f185bacd-a82c-4d58-8c30-7c93a0653c7b tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Calling method '.version_select at 0x7f82dc8bc670>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:04.849228 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-f185bacd-a82c-4d58-8c30-7c93a0653c7b tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/a22bc26a-914b-4430-a1ea-5ce14d73f0c5" status: 200 len: 286 microversion: 2.1 time: 0.043617 Sep 23 15:20:04.850624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 11/14] 10.222.0.55 () {58 vars in 1251 bytes} [Fri Sep 23 15:20:04 2022] GET /compute/v2.1/os-snapshots/a22bc26a-914b-4430-a1ea-5ce14d73f0c5 => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:20:04.862841 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6f6666a0-0b6e-4c1f-b94d-c7278618db9a tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Calling method '.version_select at 0x7f82dc937c10>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:05.073109 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-6f6666a0-0b6e-4c1f-b94d-c7278618db9a tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.214022 Sep 23 15:20:05.073762 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 4/15] 10.222.0.55 () {58 vars in 1140 bytes} [Fri Sep 23 15:20:04 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:20:05.200940 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-94aec9ea-9bed-4f7a-9782-2bd1e3bf1079 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Calling method '.version_select at 0x7f82dc8bf0d0>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:05.259724 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-94aec9ea-9bed-4f7a-9782-2bd1e3bf1079 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/a22bc26a-914b-4430-a1ea-5ce14d73f0c5" status: 200 len: 286 microversion: 2.1 time: 0.051629 Sep 23 15:20:05.259724 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 12/16] 10.222.0.55 () {58 vars in 1251 bytes} [Fri Sep 23 15:20:05 2022] GET /compute/v2.1/os-snapshots/a22bc26a-914b-4430-a1ea-5ce14d73f0c5 => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:20:06.266314 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-22fc6a41-b08b-4171-9ba9-17e513f7623f tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Calling method '.version_select at 0x7f82dc99f4c0>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:06.437958 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-22fc6a41-b08b-4171-9ba9-17e513f7623f tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/a22bc26a-914b-4430-a1ea-5ce14d73f0c5" status: 200 len: 286 microversion: 2.1 time: 0.177141 Sep 23 15:20:06.439032 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 5/17] 10.222.0.55 () {58 vars in 1251 bytes} [Fri Sep 23 15:20:06 2022] GET /compute/v2.1/os-snapshots/a22bc26a-914b-4430-a1ea-5ce14d73f0c5 => generated 286 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:20:07.452531 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-7d9774a4-fa04-4021-acea-cfbf4b94af44 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Calling method '.version_select at 0x7f82dc8bc9d0>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:07.501712 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-7d9774a4-fa04-4021-acea-cfbf4b94af44 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/a22bc26a-914b-4430-a1ea-5ce14d73f0c5" status: 200 len: 286 microversion: 2.1 time: 0.054300 Sep 23 15:20:07.508413 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 13/18] 10.222.0.55 () {58 vars in 1251 bytes} [Fri Sep 23 15:20:07 2022] GET /compute/v2.1/os-snapshots/a22bc26a-914b-4430-a1ea-5ce14d73f0c5 => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:20:08.517093 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-ee9190b6-5ec7-4cf8-9f8a-87f924c1a4e7 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Calling method '.version_select at 0x7f82dc937820>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:08.606904 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-ee9190b6-5ec7-4cf8-9f8a-87f924c1a4e7 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/a22bc26a-914b-4430-a1ea-5ce14d73f0c5" status: 200 len: 286 microversion: 2.1 time: 0.095268 Sep 23 15:20:08.608997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 6/19] 10.222.0.55 () {58 vars in 1251 bytes} [Fri Sep 23 15:20:08 2022] GET /compute/v2.1/os-snapshots/a22bc26a-914b-4430-a1ea-5ce14d73f0c5 => generated 286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:20:09.630018 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-187d0cf0-db3e-4b8e-9859-98220eacaa0e tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Calling method '.version_select at 0x7f82dc90ee50>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:09.802439 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-187d0cf0-db3e-4b8e-9859-98220eacaa0e tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/a22bc26a-914b-4430-a1ea-5ce14d73f0c5" status: 200 len: 287 microversion: 2.1 time: 0.175987 Sep 23 15:20:09.803277 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 14/20] 10.222.0.55 () {58 vars in 1251 bytes} [Fri Sep 23 15:20:09 2022] GET /compute/v2.1/os-snapshots/a22bc26a-914b-4430-a1ea-5ce14d73f0c5 => generated 287 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:20:09.814909 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-4e7ca7ee-05b5-4bd1-80bc-04d699c63f95 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Calling method '.version_select at 0x7f82dc9920d0>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:10.036094 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-9f425e65-2dc3-476d-a128-f9ba9fba3868 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Action: 'create', calling method: .version_select at 0x7f82dc9373a0>, body: {"keypair": {"name": "tempest-keypair-1705444444", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHu9TGUVvHU6uDPhLvefR60w8iTZq5wM/nBIzvMj7L5OIIbBVwTphVvj3UYiExRmBAQP/6qcvRWRQujqI5B0+AXMspkH7hqZze8aqxVo3o013oVQYBJomKMMcYCRizfuIw=="}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:20:10.060867 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-4e7ca7ee-05b5-4bd1-80bc-04d699c63f95 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] 10.222.0.55 "DELETE /compute/v2.1/os-snapshots/a22bc26a-914b-4430-a1ea-5ce14d73f0c5" status: 202 len: 0 microversion: 2.1 time: 0.249524 Sep 23 15:20:10.065777 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 15/21] 10.222.0.55 () {58 vars in 1254 bytes} [Fri Sep 23 15:20:09 2022] DELETE /compute/v2.1/os-snapshots/a22bc26a-914b-4430-a1ea-5ce14d73f0c5 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:20:10.070703 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-2eda8f4c-0817-4f86-bdfb-e03e22f66c1f tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Calling method '.version_select at 0x7f82dc8bf430>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:10.133527 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-9f425e65-2dc3-476d-a128-f9ba9fba3868 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Getting quotas for project ab19e9f7cb0e49548a9ab74b9d2b4aec. Resources: {'key_pairs'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:20:10.143623 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-9f425e65-2dc3-476d-a128-f9ba9fba3868 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Getting quotas for user f5f0ecaf38e74c96bc439fde75d93d37 and project ab19e9f7cb0e49548a9ab74b9d2b4aec. Resources: {'key_pairs'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:20:10.193345 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-2eda8f4c-0817-4f86-bdfb-e03e22f66c1f tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/a22bc26a-914b-4430-a1ea-5ce14d73f0c5" status: 200 len: 286 microversion: 2.1 time: 0.126201 Sep 23 15:20:10.200015 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 16/22] 10.222.0.55 () {58 vars in 1251 bytes} [Fri Sep 23 15:20:10 2022] GET /compute/v2.1/os-snapshots/a22bc26a-914b-4430-a1ea-5ce14d73f0c5 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:20:10.376662 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-9f425e65-2dc3-476d-a128-f9ba9fba3868 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.628034 Sep 23 15:20:10.379103 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 7/23] 10.222.0.55 () {60 vars in 1159 bytes} [Fri Sep 23 15:20:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:20:11.206387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-70bc6b3d-84c1-460f-b079-346c8474dc00 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Calling method '.version_select at 0x7f82dc90e940>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:11.292508 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-70bc6b3d-84c1-460f-b079-346c8474dc00 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/a22bc26a-914b-4430-a1ea-5ce14d73f0c5" status: 200 len: 286 microversion: 2.1 time: 0.090138 Sep 23 15:20:11.293064 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 17/24] 10.222.0.55 () {58 vars in 1251 bytes} [Fri Sep 23 15:20:11 2022] GET /compute/v2.1/os-snapshots/a22bc26a-914b-4430-a1ea-5ce14d73f0c5 => generated 286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:20:12.313697 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-69c67d55-bec0-4a67-a23e-79208c13f4c3 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Calling method '.version_select at 0x7f82dc919820>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:12.362566 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.wsgi [None req-69c67d55-bec0-4a67-a23e-79208c13f4c3 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] HTTP exception thrown: Snapshot a22bc26a-914b-4430-a1ea-5ce14d73f0c5 could not be found. Sep 23 15:20:12.367627 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-69c67d55-bec0-4a67-a23e-79208c13f4c3 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Request method failure captured: Sep 23 15:20:12.367627 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: request: GET /compute/v2.1/os-snapshots/a22bc26a-914b-4430-a1ea-5ce14d73f0c5 HTTP/1.1 Sep 23 15:20:12.367627 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept: application/json Sep 23 15:20:12.367627 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept-Encoding: identity Sep 23 15:20:12.367627 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Connection: close Sep 23 15:20:12.367627 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Length: 0 Sep 23 15:20:12.367627 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Type: application/json Sep 23 15:20:12.367627 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Host: 10.222.0.55 Sep 23 15:20:12.367627 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Openstack-System-Scope: None Sep 23 15:20:12.367627 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: User-Agent: python-urllib3/1.26.12 Sep 23 15:20:12.367627 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Auth-Token: gAAAAABjLc6dLfm-ngc9DIT4iwqUewh9AeYKgcNy4XAOsanC1nZm4LO93Yj3sX6uqsCaDxBgCwtMmDLQ0fgWPxjbJfOZoLplsofLNjzUL3RpULXegph7o4ti-mqD1kpIp2oy4cy3gl44VAUZouQJcVO6Lo1wwbHWiO8LemA1RYygDhn5DizX2hI Sep 23 15:20:12.367627 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Id: None Sep 23 15:20:12.367627 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Name: None Sep 23 15:20:12.367627 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Identity-Status: Confirmed Sep 23 15:20:12.367627 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Is-Admin-Project: True Sep 23 15:20:12.367627 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Id: default Sep 23 15:20:12.367627 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Name: Default Sep 23 15:20:12.367627 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Id: f87732b5735542ec8efcd0f8d43a0e76 Sep 23 15:20:12.367627 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-771626091 Sep 23 15:20:12.367627 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Role: reader,member Sep 23 15:20:12.367627 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Roles: reader,member Sep 23 15:20:12.376236 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f87732b5735542ec8efcd0f8d43a0e76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f87732b5735542ec8efcd0f8d43a0e76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f87732b5735542ec8efcd0f8d43a0e76", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f87732b5735542ec8efcd0f8d43a0e76"}]}] Sep 23 15:20:12.376236 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant: tempest-VolumesSnapshotsTestJSON-771626091 Sep 23 15:20:12.376236 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Id: f87732b5735542ec8efcd0f8d43a0e76 Sep 23 15:20:12.376236 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-771626091 Sep 23 15:20:12.376236 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User: tempest-VolumesSnapshotsTestJSON-771626091-project Sep 23 15:20:12.376236 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Id: default Sep 23 15:20:12.376236 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Name: Default Sep 23 15:20:12.376236 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Id: c500d775ea144aa48ba2b4db12ec3407 Sep 23 15:20:12.376236 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Name: tempest-VolumesSnapshotsTestJSON-771626091-project Sep 23 15:20:12.376236 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: method: Sep 23 15:20:12.376236 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: exception: Snapshot a22bc26a-914b-4430-a1ea-5ce14d73f0c5 could not be found. Sep 23 15:20:12.376236 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: action_args: {'id': 'a22bc26a-914b-4430-a1ea-5ce14d73f0c5'} Sep 23 15:20:12.376236 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:20:12.376946 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:12.376946 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 23 15:20:12.376946 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 23 15:20:12.376946 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 23 15:20:12.376946 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 23 15:20:12.376946 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 23 15:20:12.376946 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 23 15:20:12.376946 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 15:20:12.376946 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 15:20:12.376946 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 15:20:12.376946 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 15:20:12.376946 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:20:12.376946 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:20:12.376946 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:20:12.376946 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:20:12.376946 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a22bc26a-914b-4430-a1ea-5ce14d73f0c5 could not be found. (HTTP 404) (Request-ID: req-a6a38cda-de26-4cde-9d72-6abe4b8424d6) Sep 23 15:20:12.376946 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:20:12.376946 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:12.378097 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:20:12.378097 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:12.378097 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 23 15:20:12.378097 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 23 15:20:12.378097 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 15:20:12.378097 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 15:20:12.378097 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 23 15:20:12.378097 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 23 15:20:12.378097 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 15:20:12.378097 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 15:20:12.378097 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 23 15:20:12.378097 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 23 15:20:12.378097 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 23 15:20:12.378097 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 23 15:20:12.378097 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 23 15:20:12.378097 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 23 15:20:12.378097 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 15:20:12.378097 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 15:20:12.378097 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 15:20:12.379057 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 15:20:12.379057 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:20:12.379057 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:20:12.379057 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:20:12.379057 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:20:12.379057 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a22bc26a-914b-4430-a1ea-5ce14d73f0c5 could not be found. Sep 23 15:20:12.379057 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:20:12.379057 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:12.379057 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:20:12.379057 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:12.379057 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:20:12.379057 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:20:12.379057 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:20:12.379057 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:20:12.379057 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 15:20:12.379057 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 15:20:12.379057 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:20:12.379057 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:20:12.379057 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 23 15:20:12.379057 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:20:12.381512 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a22bc26a-914b-4430-a1ea-5ce14d73f0c5 could not be found. Sep 23 15:20:12.381512 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:20:12.381512 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:12.381512 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:20:12.381512 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:12.381512 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:20:12.381512 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:20:12.381512 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:20:12.381512 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:20:12.381512 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a22bc26a-914b-4430-a1ea-5ce14d73f0c5 could not be found. Sep 23 15:20:12.381512 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:20:12.381512 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-69c67d55-bec0-4a67-a23e-79208c13f4c3 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Returning 404 to user: Snapshot a22bc26a-914b-4430-a1ea-5ce14d73f0c5 could not be found. {{(pid=121448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:20:12.381512 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-69c67d55-bec0-4a67-a23e-79208c13f4c3 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/a22bc26a-914b-4430-a1ea-5ce14d73f0c5" status: 404 len: 111 microversion: 2.1 time: 0.068166 Sep 23 15:20:12.381512 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 8/25] 10.222.0.55 () {58 vars in 1251 bytes} [Fri Sep 23 15:20:12 2022] GET /compute/v2.1/os-snapshots/a22bc26a-914b-4430-a1ea-5ce14d73f0c5 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:20:12.383249 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-f9dc850f-dd34-43db-8727-192ad3a3cb5f tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Calling method '.version_select at 0x7f82dc8bcf70>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:12.820475 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-f9dc850f-dd34-43db-8727-192ad3a3cb5f tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/b7455d19-23f8-4f30-872a-184462254429" status: 202 len: 0 microversion: 2.1 time: 0.440788 Sep 23 15:20:12.824658 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 18/26] 10.222.0.55 () {58 vars in 1248 bytes} [Fri Sep 23 15:20:12 2022] DELETE /compute/v2.1/os-volumes/b7455d19-23f8-4f30-872a-184462254429 => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:20:12.831420 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-55692b84-254f-4c1c-b512-da930fdcfe02 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Calling method '.version_select at 0x7f82dc99f310>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:12.941442 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-55692b84-254f-4c1c-b512-da930fdcfe02 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/b7455d19-23f8-4f30-872a-184462254429" status: 200 len: 344 microversion: 2.1 time: 0.114357 Sep 23 15:20:12.942887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 9/27] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Sep 23 15:20:12 2022] GET /compute/v2.1/os-volumes/b7455d19-23f8-4f30-872a-184462254429 => generated 344 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:20:13.959284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-6df974cc-bcd7-48a2-b1a3-754d040b75ea tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Calling method '.version_select at 0x7f82dc8bc040>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:14.011022 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-6df974cc-bcd7-48a2-b1a3-754d040b75ea tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] HTTP exception thrown: Volume b7455d19-23f8-4f30-872a-184462254429 could not be found. Sep 23 15:20:14.013894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-6df974cc-bcd7-48a2-b1a3-754d040b75ea tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Request method failure captured: Sep 23 15:20:14.013894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: GET /compute/v2.1/os-volumes/b7455d19-23f8-4f30-872a-184462254429 HTTP/1.1 Sep 23 15:20:14.013894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:20:14.013894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:20:14.013894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:20:14.013894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:20:14.013894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:20:14.013894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:20:14.013894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:20:14.013894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:20:14.013894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLc6dLfm-ngc9DIT4iwqUewh9AeYKgcNy4XAOsanC1nZm4LO93Yj3sX6uqsCaDxBgCwtMmDLQ0fgWPxjbJfOZoLplsofLNjzUL3RpULXegph7o4ti-mqD1kpIp2oy4cy3gl44VAUZouQJcVO6Lo1wwbHWiO8LemA1RYygDhn5DizX2hI Sep 23 15:20:14.013894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:20:14.013894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:20:14.013894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:20:14.013894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:20:14.013894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:20:14.013894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:20:14.013894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: f87732b5735542ec8efcd0f8d43a0e76 Sep 23 15:20:14.013894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-771626091 Sep 23 15:20:14.013894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:20:14.013894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:20:14.015089 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f87732b5735542ec8efcd0f8d43a0e76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f87732b5735542ec8efcd0f8d43a0e76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f87732b5735542ec8efcd0f8d43a0e76", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f87732b5735542ec8efcd0f8d43a0e76"}]}] Sep 23 15:20:14.015089 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-VolumesSnapshotsTestJSON-771626091 Sep 23 15:20:14.015089 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: f87732b5735542ec8efcd0f8d43a0e76 Sep 23 15:20:14.015089 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-771626091 Sep 23 15:20:14.015089 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-VolumesSnapshotsTestJSON-771626091-project Sep 23 15:20:14.015089 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:20:14.015089 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:20:14.015089 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: c500d775ea144aa48ba2b4db12ec3407 Sep 23 15:20:14.015089 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-VolumesSnapshotsTestJSON-771626091-project Sep 23 15:20:14.015089 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: Sep 23 15:20:14.015089 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Volume b7455d19-23f8-4f30-872a-184462254429 could not be found. Sep 23 15:20:14.015089 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': 'b7455d19-23f8-4f30-872a-184462254429'} Sep 23 15:20:14.015089 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:20:14.015792 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:14.015792 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:20:14.015792 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:20:14.015792 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 15:20:14.015792 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 15:20:14.015792 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 15:20:14.015792 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 15:20:14.015792 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 15:20:14.015792 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 15:20:14.015792 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 15:20:14.015792 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 15:20:14.015792 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:20:14.015792 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:20:14.015792 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:20:14.015792 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:20:14.015792 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b7455d19-23f8-4f30-872a-184462254429 could not be found. (HTTP 404) (Request-ID: req-6e27f30e-1209-4134-9d26-a789835466f2) Sep 23 15:20:14.015792 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:14.015792 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:14.015792 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:14.017073 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:14.017073 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 23 15:20:14.017073 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 23 15:20:14.017073 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 15:20:14.017073 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 15:20:14.017073 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 15:20:14.017073 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 15:20:14.017073 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 15:20:14.017073 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 15:20:14.017073 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:20:14.017073 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:20:14.017073 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 15:20:14.017073 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 15:20:14.017073 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 15:20:14.017073 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 15:20:14.017073 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 15:20:14.017073 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 15:20:14.017073 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 15:20:14.017073 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 15:20:14.018599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:20:14.018599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:20:14.018599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:20:14.018599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:20:14.018599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b7455d19-23f8-4f30-872a-184462254429 could not be found. Sep 23 15:20:14.018599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:14.018599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:14.018599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:14.018599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:14.018599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:20:14.018599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:20:14.018599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:20:14.018599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:20:14.018599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 15:20:14.018599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 15:20:14.018599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:20:14.018599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:20:14.018599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 23 15:20:14.018599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:20:14.019541 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b7455d19-23f8-4f30-872a-184462254429 could not be found. Sep 23 15:20:14.019541 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:14.019541 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:14.019541 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:14.019541 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:14.019541 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:20:14.019541 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:20:14.019541 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:20:14.019541 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:20:14.019541 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b7455d19-23f8-4f30-872a-184462254429 could not be found. Sep 23 15:20:14.019541 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:14.019541 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-6df974cc-bcd7-48a2-b1a3-754d040b75ea tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Returning 404 to user: Volume b7455d19-23f8-4f30-872a-184462254429 could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:20:14.019541 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-6df974cc-bcd7-48a2-b1a3-754d040b75ea tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/b7455d19-23f8-4f30-872a-184462254429" status: 404 len: 109 microversion: 2.1 time: 0.062470 Sep 23 15:20:14.025777 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 19/28] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Sep 23 15:20:13 2022] GET /compute/v2.1/os-volumes/b7455d19-23f8-4f30-872a-184462254429 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:20:14.031911 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-153256f1-d24c-4a44-8b1a-b97515fa4122 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Calling method '.version_select at 0x7f82dc9193a0>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:14.082006 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.wsgi [None req-153256f1-d24c-4a44-8b1a-b97515fa4122 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] HTTP exception thrown: Volume b7455d19-23f8-4f30-872a-184462254429 could not be found. Sep 23 15:20:14.086338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-153256f1-d24c-4a44-8b1a-b97515fa4122 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Request method failure captured: Sep 23 15:20:14.086338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: request: DELETE /compute/v2.1/os-volumes/b7455d19-23f8-4f30-872a-184462254429 HTTP/1.1 Sep 23 15:20:14.086338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept: application/json Sep 23 15:20:14.086338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept-Encoding: identity Sep 23 15:20:14.086338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Connection: close Sep 23 15:20:14.086338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Length: 0 Sep 23 15:20:14.086338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Type: application/json Sep 23 15:20:14.086338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Host: 10.222.0.55 Sep 23 15:20:14.086338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Openstack-System-Scope: None Sep 23 15:20:14.086338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: User-Agent: python-urllib3/1.26.12 Sep 23 15:20:14.086338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Auth-Token: gAAAAABjLc6dLfm-ngc9DIT4iwqUewh9AeYKgcNy4XAOsanC1nZm4LO93Yj3sX6uqsCaDxBgCwtMmDLQ0fgWPxjbJfOZoLplsofLNjzUL3RpULXegph7o4ti-mqD1kpIp2oy4cy3gl44VAUZouQJcVO6Lo1wwbHWiO8LemA1RYygDhn5DizX2hI Sep 23 15:20:14.086338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Id: None Sep 23 15:20:14.086338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Name: None Sep 23 15:20:14.086338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Identity-Status: Confirmed Sep 23 15:20:14.086338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Is-Admin-Project: True Sep 23 15:20:14.086338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Id: default Sep 23 15:20:14.086338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Name: Default Sep 23 15:20:14.086338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Id: f87732b5735542ec8efcd0f8d43a0e76 Sep 23 15:20:14.086338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-771626091 Sep 23 15:20:14.086338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Role: reader,member Sep 23 15:20:14.086338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Roles: reader,member Sep 23 15:20:14.087500 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f87732b5735542ec8efcd0f8d43a0e76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f87732b5735542ec8efcd0f8d43a0e76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f87732b5735542ec8efcd0f8d43a0e76", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f87732b5735542ec8efcd0f8d43a0e76"}]}] Sep 23 15:20:14.087500 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant: tempest-VolumesSnapshotsTestJSON-771626091 Sep 23 15:20:14.087500 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Id: f87732b5735542ec8efcd0f8d43a0e76 Sep 23 15:20:14.087500 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-771626091 Sep 23 15:20:14.087500 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User: tempest-VolumesSnapshotsTestJSON-771626091-project Sep 23 15:20:14.087500 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Id: default Sep 23 15:20:14.087500 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Name: Default Sep 23 15:20:14.087500 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Id: c500d775ea144aa48ba2b4db12ec3407 Sep 23 15:20:14.087500 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Name: tempest-VolumesSnapshotsTestJSON-771626091-project Sep 23 15:20:14.087500 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: method: Sep 23 15:20:14.087500 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: exception: Volume b7455d19-23f8-4f30-872a-184462254429 could not be found. Sep 23 15:20:14.087500 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: action_args: {'id': 'b7455d19-23f8-4f30-872a-184462254429'} Sep 23 15:20:14.087500 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:20:14.088171 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:14.088171 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:20:14.088171 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:20:14.088171 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 15:20:14.088171 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 15:20:14.088171 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 15:20:14.088171 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 15:20:14.088171 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 15:20:14.088171 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 15:20:14.088171 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 15:20:14.088171 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 15:20:14.088171 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:20:14.088171 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:20:14.088171 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:20:14.088171 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:20:14.088171 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b7455d19-23f8-4f30-872a-184462254429 could not be found. (HTTP 404) (Request-ID: req-0f99008c-efb3-499f-9d0c-e950c86dc48e) Sep 23 15:20:14.088171 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:20:14.088171 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:14.088171 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:20:14.089141 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:14.089141 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 23 15:20:14.089141 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 23 15:20:14.089141 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 15:20:14.089141 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 15:20:14.089141 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 15:20:14.089141 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 15:20:14.089141 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 15:20:14.089141 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 15:20:14.089141 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:20:14.089141 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:20:14.089141 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 15:20:14.089141 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 15:20:14.089141 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 15:20:14.089141 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 15:20:14.089141 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 15:20:14.089141 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 15:20:14.089141 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 15:20:14.089141 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 15:20:14.091803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:20:14.091803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:20:14.091803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:20:14.091803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:20:14.091803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b7455d19-23f8-4f30-872a-184462254429 could not be found. Sep 23 15:20:14.091803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:20:14.091803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:14.091803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:20:14.091803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:14.091803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:20:14.091803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:20:14.091803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:20:14.091803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:20:14.091803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 15:20:14.091803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 15:20:14.091803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:20:14.091803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:20:14.091803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 23 15:20:14.091803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:20:14.093920 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b7455d19-23f8-4f30-872a-184462254429 could not be found. Sep 23 15:20:14.093920 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:20:14.093920 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:14.093920 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:20:14.093920 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:14.093920 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:20:14.093920 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:20:14.093920 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:20:14.093920 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:20:14.093920 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b7455d19-23f8-4f30-872a-184462254429 could not be found. Sep 23 15:20:14.093920 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:20:14.093920 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-153256f1-d24c-4a44-8b1a-b97515fa4122 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Returning 404 to user: Volume b7455d19-23f8-4f30-872a-184462254429 could not be found. {{(pid=121448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:20:14.095703 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-153256f1-d24c-4a44-8b1a-b97515fa4122 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/b7455d19-23f8-4f30-872a-184462254429" status: 404 len: 109 microversion: 2.1 time: 0.064654 Sep 23 15:20:14.097952 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 10/29] 10.222.0.55 () {58 vars in 1248 bytes} [Fri Sep 23 15:20:14 2022] DELETE /compute/v2.1/os-volumes/b7455d19-23f8-4f30-872a-184462254429 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 15:20:14.109706 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-924349ed-fbb1-4308-b77f-6402a75a4bb0 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Calling method '.version_select at 0x7f82dc8bc0d0>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:14.152761 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-924349ed-fbb1-4308-b77f-6402a75a4bb0 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] HTTP exception thrown: Volume b7455d19-23f8-4f30-872a-184462254429 could not be found. Sep 23 15:20:14.155593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-924349ed-fbb1-4308-b77f-6402a75a4bb0 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Request method failure captured: Sep 23 15:20:14.155593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: GET /compute/v2.1/os-volumes/b7455d19-23f8-4f30-872a-184462254429 HTTP/1.1 Sep 23 15:20:14.155593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:20:14.155593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:20:14.155593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:20:14.155593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:20:14.155593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:20:14.155593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:20:14.155593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:20:14.155593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:20:14.155593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLc6dLfm-ngc9DIT4iwqUewh9AeYKgcNy4XAOsanC1nZm4LO93Yj3sX6uqsCaDxBgCwtMmDLQ0fgWPxjbJfOZoLplsofLNjzUL3RpULXegph7o4ti-mqD1kpIp2oy4cy3gl44VAUZouQJcVO6Lo1wwbHWiO8LemA1RYygDhn5DizX2hI Sep 23 15:20:14.155593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:20:14.155593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:20:14.155593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:20:14.155593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:20:14.155593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:20:14.155593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:20:14.155593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: f87732b5735542ec8efcd0f8d43a0e76 Sep 23 15:20:14.155593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-771626091 Sep 23 15:20:14.155593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:20:14.155593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:20:14.156768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f87732b5735542ec8efcd0f8d43a0e76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f87732b5735542ec8efcd0f8d43a0e76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f87732b5735542ec8efcd0f8d43a0e76", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f87732b5735542ec8efcd0f8d43a0e76"}]}] Sep 23 15:20:14.156768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-VolumesSnapshotsTestJSON-771626091 Sep 23 15:20:14.156768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: f87732b5735542ec8efcd0f8d43a0e76 Sep 23 15:20:14.156768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-771626091 Sep 23 15:20:14.156768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-VolumesSnapshotsTestJSON-771626091-project Sep 23 15:20:14.156768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:20:14.156768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:20:14.156768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: c500d775ea144aa48ba2b4db12ec3407 Sep 23 15:20:14.156768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-VolumesSnapshotsTestJSON-771626091-project Sep 23 15:20:14.156768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: Sep 23 15:20:14.156768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Volume b7455d19-23f8-4f30-872a-184462254429 could not be found. Sep 23 15:20:14.156768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': 'b7455d19-23f8-4f30-872a-184462254429'} Sep 23 15:20:14.156768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:20:14.157415 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:14.157415 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:20:14.157415 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:20:14.157415 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 15:20:14.157415 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 15:20:14.157415 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 15:20:14.157415 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 15:20:14.157415 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 15:20:14.157415 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 15:20:14.157415 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 15:20:14.157415 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 15:20:14.157415 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:20:14.157415 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:20:14.157415 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:20:14.157415 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:20:14.157415 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b7455d19-23f8-4f30-872a-184462254429 could not be found. (HTTP 404) (Request-ID: req-238bd57a-a9b6-404c-9e16-b2d8c3348c92) Sep 23 15:20:14.157415 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:14.157415 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:14.157415 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:14.158409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:14.158409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 23 15:20:14.158409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 23 15:20:14.158409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 15:20:14.158409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 15:20:14.158409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 15:20:14.158409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 15:20:14.158409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 15:20:14.158409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 15:20:14.158409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:20:14.158409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:20:14.158409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 15:20:14.158409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 15:20:14.158409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 15:20:14.158409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 15:20:14.158409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 15:20:14.158409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 15:20:14.158409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 15:20:14.158409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 15:20:14.159364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:20:14.159364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:20:14.159364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:20:14.159364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:20:14.159364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b7455d19-23f8-4f30-872a-184462254429 could not be found. Sep 23 15:20:14.159364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:14.159364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:14.159364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:14.159364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:14.159364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:20:14.159364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:20:14.159364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:20:14.159364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:20:14.159364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 15:20:14.159364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 15:20:14.159364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:20:14.159364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:20:14.159364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 23 15:20:14.159364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:20:14.160289 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b7455d19-23f8-4f30-872a-184462254429 could not be found. Sep 23 15:20:14.160289 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:14.160289 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:14.160289 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:14.160289 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:14.160289 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:20:14.160289 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:20:14.160289 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:20:14.160289 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:20:14.160289 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b7455d19-23f8-4f30-872a-184462254429 could not be found. Sep 23 15:20:14.160289 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:20:14.163350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-924349ed-fbb1-4308-b77f-6402a75a4bb0 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] Returning 404 to user: Volume b7455d19-23f8-4f30-872a-184462254429 could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:20:14.164519 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-924349ed-fbb1-4308-b77f-6402a75a4bb0 tempest-VolumesSnapshotsTestJSON-771626091 tempest-VolumesSnapshotsTestJSON-771626091-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/b7455d19-23f8-4f30-872a-184462254429" status: 404 len: 109 microversion: 2.1 time: 0.062347 Sep 23 15:20:14.165278 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 20/30] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Sep 23 15:20:14 2022] GET /compute/v2.1/os-volumes/b7455d19-23f8-4f30-872a-184462254429 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:20:17.850566 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-1c36cffa-7680-468f-a43b-5aaceab3df08 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-194104080", "imageRef": "051c4746-7f50-4edb-b09d-a8935df360de", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:20:17.988414 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.network.neutron [None req-1c36cffa-7680-468f-a43b-5aaceab3df08 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] validate_networks() for [('0fed3158-67d0-44f2-9c11-c1330461e633', None, None, None, None, None)] {{(pid=121448) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:20:19.967401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-1c36cffa-7680-468f-a43b-5aaceab3df08 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Flavor limits 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:20:19.967915 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-1c36cffa-7680-468f-a43b-5aaceab3df08 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Image limits 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:20:19.968508 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-1c36cffa-7680-468f-a43b-5aaceab3df08 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Flavor pref 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:20:19.969013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-1c36cffa-7680-468f-a43b-5aaceab3df08 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Image pref 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:20:19.969600 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-1c36cffa-7680-468f-a43b-5aaceab3df08 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:20:19.997706 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1c36cffa-7680-468f-a43b-5aaceab3df08 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:19.998600 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1c36cffa-7680-468f-a43b-5aaceab3df08 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:19.999562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1c36cffa-7680-468f-a43b-5aaceab3df08 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:20.001123 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1c36cffa-7680-468f-a43b-5aaceab3df08 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:20.003263 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1c36cffa-7680-468f-a43b-5aaceab3df08 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:20.004394 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1c36cffa-7680-468f-a43b-5aaceab3df08 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:20.068458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-1c36cffa-7680-468f-a43b-5aaceab3df08 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Getting quotas for project a079aa0c75bf44619342f53006d88ff9. Resources: {'ram', 'instances', 'cores'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:20:20.084644 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-1c36cffa-7680-468f-a43b-5aaceab3df08 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Getting quotas for user a5514abdc8b54282901367a4f2d02856 and project a079aa0c75bf44619342f53006d88ff9. Resources: {'ram', 'instances', 'cores'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:20:20.107598 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-1c36cffa-7680-468f-a43b-5aaceab3df08 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Going to run 1 instances... {{(pid=121448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:20:20.129701 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-1c36cffa-7680-468f-a43b-5aaceab3df08 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='051c4746-7f50-4edb-b09d-a8935df360de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:20:20.236466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-ffb5c6d1-2b17-471d-be64-4e0c7b5bb189 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Action: 'create', calling method: .version_select at 0x7f82dc8bf160>, body: {"keypair": {"name": "tempest-keypair-2038150903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV9NP7t1wF+0e5TYYy7OMtK/RwQ3bAtBzKtQQlMcIlS05Hj9xbrN9vDymXNTyX1wZFaxzHwIwIfpIgVQarHq0ZO1GiR+DYunvZT57RsjoOflh6tK4MNBkKBAperxaNM4A=="}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:20:20.298861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-ffb5c6d1-2b17-471d-be64-4e0c7b5bb189 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Getting quotas for project 1679242155f94d48871525425f74d1c3. Resources: {'key_pairs'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:20:20.309247 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-ffb5c6d1-2b17-471d-be64-4e0c7b5bb189 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Getting quotas for user 42dc378333ae4bbdbd42ce041ba15d3f and project 1679242155f94d48871525425f74d1c3. Resources: {'key_pairs'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:20:20.332314 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-1c36cffa-7680-468f-a43b-5aaceab3df08 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.670695 Sep 23 15:20:20.333019 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 11/31] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Sep 23 15:20:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 2672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 15:20:20.345550 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-bdf3b12b-340f-4adb-8fe1-c79c61eb7de6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:20.346185 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-bdf3b12b-340f-4adb-8fe1-c79c61eb7de6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:20.508093 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-ffb5c6d1-2b17-471d-be64-4e0c7b5bb189 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.836608 Sep 23 15:20:20.508572 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 21/32] 10.222.0.55 () {62 vars in 1200 bytes} [Fri Sep 23 15:20:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 838 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 23 15:20:20.527125 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-bdf3b12b-340f-4adb-8fe1-c79c61eb7de6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:20.546045 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-bdf3b12b-340f-4adb-8fe1-c79c61eb7de6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 200 len: 1221 microversion: 2.1 time: 0.202313 Sep 23 15:20:20.548448 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 12/33] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:20 2022] GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 1221 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:20.651593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-bb8f2ab5-f681-4d9c-a449-ecc508943e5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-342120094", "imageRef": "051c4746-7f50-4edb-b09d-a8935df360de", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b3f7a81d-77e4-45ed-aa33-730087d69ce7"}], "security_groups": [{"name": "tempest-securitygroup--1500271274"}], "key_name": "tempest-keypair-1705444444", "user_data": "}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:20:20.910762 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.network.neutron [None req-bb8f2ab5-f681-4d9c-a449-ecc508943e5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] validate_networks() for [('b3f7a81d-77e4-45ed-aa33-730087d69ce7', None, None, None, None, None)] {{(pid=121450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:20:21.276549 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a307cfda-95a6-417a-85d5-6e0bd508050e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1059343324", "imageRef": "051c4746-7f50-4edb-b09d-a8935df360de", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:20:21.386592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.network.neutron [None req-a307cfda-95a6-417a-85d5-6e0bd508050e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] validate_networks() for [('0fed3158-67d0-44f2-9c11-c1330461e633', None, None, None, None, None)] {{(pid=121448) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:20:22.271278 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-a307cfda-95a6-417a-85d5-6e0bd508050e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Flavor limits 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:20:22.271278 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-a307cfda-95a6-417a-85d5-6e0bd508050e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Image limits 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:20:22.271278 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-a307cfda-95a6-417a-85d5-6e0bd508050e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Flavor pref 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:20:22.271278 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-a307cfda-95a6-417a-85d5-6e0bd508050e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Image pref 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:20:22.271278 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-a307cfda-95a6-417a-85d5-6e0bd508050e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:20:22.271767 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a307cfda-95a6-417a-85d5-6e0bd508050e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:22.271767 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a307cfda-95a6-417a-85d5-6e0bd508050e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:22.272469 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a307cfda-95a6-417a-85d5-6e0bd508050e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:22.273321 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a307cfda-95a6-417a-85d5-6e0bd508050e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:22.274016 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a307cfda-95a6-417a-85d5-6e0bd508050e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:22.275035 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a307cfda-95a6-417a-85d5-6e0bd508050e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:22.354848 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-a307cfda-95a6-417a-85d5-6e0bd508050e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Getting quotas for project a079aa0c75bf44619342f53006d88ff9. Resources: {'ram', 'instances', 'cores'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:20:22.361837 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-a307cfda-95a6-417a-85d5-6e0bd508050e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Getting quotas for user a5514abdc8b54282901367a4f2d02856 and project a079aa0c75bf44619342f53006d88ff9. Resources: {'ram', 'instances', 'cores'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:20:22.378515 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-a307cfda-95a6-417a-85d5-6e0bd508050e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Going to run 1 instances... {{(pid=121448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:20:22.396506 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-a307cfda-95a6-417a-85d5-6e0bd508050e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='051c4746-7f50-4edb-b09d-a8935df360de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:20:22.609198 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-a307cfda-95a6-417a-85d5-6e0bd508050e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.336154 Sep 23 15:20:22.610872 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 13/34] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Sep 23 15:20:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 1340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:20:22.799404 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-bb8f2ab5-f681-4d9c-a449-ecc508943e5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Flavor limits 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:20:22.799846 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-bb8f2ab5-f681-4d9c-a449-ecc508943e5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Image limits 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:20:22.800323 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-bb8f2ab5-f681-4d9c-a449-ecc508943e5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Flavor pref 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:20:22.800732 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-bb8f2ab5-f681-4d9c-a449-ecc508943e5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Image pref 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:20:22.801154 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-bb8f2ab5-f681-4d9c-a449-ecc508943e5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:20:22.820108 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bb8f2ab5-f681-4d9c-a449-ecc508943e5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:22.820602 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bb8f2ab5-f681-4d9c-a449-ecc508943e5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:22.826892 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bb8f2ab5-f681-4d9c-a449-ecc508943e5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:22.829397 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bb8f2ab5-f681-4d9c-a449-ecc508943e5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:22.831993 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bb8f2ab5-f681-4d9c-a449-ecc508943e5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:22.835768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bb8f2ab5-f681-4d9c-a449-ecc508943e5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:22.901314 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-bb8f2ab5-f681-4d9c-a449-ecc508943e5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Getting quotas for project ab19e9f7cb0e49548a9ab74b9d2b4aec. Resources: {'ram', 'instances', 'cores'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:20:22.912369 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-bb8f2ab5-f681-4d9c-a449-ecc508943e5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Getting quotas for user f5f0ecaf38e74c96bc439fde75d93d37 and project ab19e9f7cb0e49548a9ab74b9d2b4aec. Resources: {'ram', 'instances', 'cores'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:20:22.955596 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-bb8f2ab5-f681-4d9c-a449-ecc508943e5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Going to run 1 instances... {{(pid=121450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:20:22.958454 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-bb8f2ab5-f681-4d9c-a449-ecc508943e5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='051c4746-7f50-4edb-b09d-a8935df360de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:20:23.201849 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-edb080c0-afb7-43e3-a80f-6b14435f2013 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-395687651", "imageRef": "051c4746-7f50-4edb-b09d-a8935df360de", "flavorRef": "452", "networks": [{"uuid": "080dabf7-2261-4812-9a7c-bfee5308b800"}]}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:20:23.325158 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.network.neutron [None req-edb080c0-afb7-43e3-a80f-6b14435f2013 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] validate_networks() for [('080dabf7-2261-4812-9a7c-bfee5308b800', None, None, None, None, None)] {{(pid=121448) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:20:23.401758 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-bb8f2ab5-f681-4d9c-a449-ecc508943e5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.754786 Sep 23 15:20:23.406758 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 22/35] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Sep 23 15:20:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 2761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:20:23.427820 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-bae805e9-cb0c-470f-b008-0b9687cc454d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:23.430921 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-bae805e9-cb0c-470f-b008-0b9687cc454d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:23.665041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-bae805e9-cb0c-470f-b008-0b9687cc454d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:23.685344 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-bae805e9-cb0c-470f-b008-0b9687cc454d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1222 microversion: 2.1 time: 0.277305 Sep 23 15:20:23.686481 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 23/36] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:23 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1222 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:23.692513 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-4047c236-b020-47f6-8e49-d3bdc954ca42 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:23.693157 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-4047c236-b020-47f6-8e49-d3bdc954ca42 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:24.188424 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-4047c236-b020-47f6-8e49-d3bdc954ca42 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:24.200687 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-4047c236-b020-47f6-8e49-d3bdc954ca42 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1237 microversion: 2.1 time: 0.512854 Sep 23 15:20:24.201888 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 24/37] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:23 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1237 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:24.367520 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-edb080c0-afb7-43e3-a80f-6b14435f2013 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Flavor limits 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:20:24.368085 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-edb080c0-afb7-43e3-a80f-6b14435f2013 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Image limits 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:20:24.368511 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-edb080c0-afb7-43e3-a80f-6b14435f2013 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Flavor pref 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:20:24.368936 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-edb080c0-afb7-43e3-a80f-6b14435f2013 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Image pref 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:20:24.369491 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-edb080c0-afb7-43e3-a80f-6b14435f2013 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:20:24.385143 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-edb080c0-afb7-43e3-a80f-6b14435f2013 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:24.386005 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-edb080c0-afb7-43e3-a80f-6b14435f2013 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:24.386624 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-edb080c0-afb7-43e3-a80f-6b14435f2013 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:24.388108 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-edb080c0-afb7-43e3-a80f-6b14435f2013 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:24.424576 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-edb080c0-afb7-43e3-a80f-6b14435f2013 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:24.426621 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-edb080c0-afb7-43e3-a80f-6b14435f2013 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:24.481833 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-edb080c0-afb7-43e3-a80f-6b14435f2013 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Getting quotas for project df328392b4f54d0c92df32df0241e95d. Resources: {'ram', 'instances', 'cores'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:20:24.495587 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-edb080c0-afb7-43e3-a80f-6b14435f2013 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Getting quotas for user 69dc5c52e36841f5aad028fc6a4b3daf and project df328392b4f54d0c92df32df0241e95d. Resources: {'ram', 'instances', 'cores'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:20:24.571734 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-edb080c0-afb7-43e3-a80f-6b14435f2013 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Going to run 1 instances... {{(pid=121448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:20:24.583587 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-edb080c0-afb7-43e3-a80f-6b14435f2013 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='051c4746-7f50-4edb-b09d-a8935df360de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:20:24.712618 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-54784df7-e53f-4f20-9528-94d4744c9a6e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:24.716868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-54784df7-e53f-4f20-9528-94d4744c9a6e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:24.852885 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-54784df7-e53f-4f20-9528-94d4744c9a6e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:24.868056 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-54784df7-e53f-4f20-9528-94d4744c9a6e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1222 microversion: 2.1 time: 0.161568 Sep 23 15:20:24.877077 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 25/38] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:24 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1222 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:24.883386 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-edb080c0-afb7-43e3-a80f-6b14435f2013 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.270373 Sep 23 15:20:24.893490 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 14/39] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Sep 23 15:20:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:20:24.901505 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-9736b690-8f6f-4dc7-b7a9-37db34f84249 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:24.906144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-9736b690-8f6f-4dc7-b7a9-37db34f84249 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:25.163310 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-9736b690-8f6f-4dc7-b7a9-37db34f84249 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:25.178884 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-9736b690-8f6f-4dc7-b7a9-37db34f84249 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1214 microversion: 2.1 time: 0.283482 Sep 23 15:20:25.181059 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 26/40] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:24 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1214 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:25.231308 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a0c706ec-c173-4175-8573-866d618b66e3 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:25.232121 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-a0c706ec-c173-4175-8573-866d618b66e3 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:25.350210 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a0c706ec-c173-4175-8573-866d618b66e3 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:25.384240 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-a0c706ec-c173-4175-8573-866d618b66e3 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1237 microversion: 2.1 time: 0.156942 Sep 23 15:20:25.385352 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 15/41] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:25 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1237 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:25.902448 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-8e5a6eff-73f1-41a1-94e5-8bd0be3f2dae tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:25.903250 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-8e5a6eff-73f1-41a1-94e5-8bd0be3f2dae tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:25.911111 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8e5a6eff-73f1-41a1-94e5-8bd0be3f2dae tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:25.913019 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8e5a6eff-73f1-41a1-94e5-8bd0be3f2dae tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:25.913643 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8e5a6eff-73f1-41a1-94e5-8bd0be3f2dae tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:25.914526 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8e5a6eff-73f1-41a1-94e5-8bd0be3f2dae tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:25.915198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8e5a6eff-73f1-41a1-94e5-8bd0be3f2dae tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:25.916414 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8e5a6eff-73f1-41a1-94e5-8bd0be3f2dae tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:26.211968 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-d528b51b-17ef-4013-9a9d-5517fd9c7e7d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:26.212766 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-d528b51b-17ef-4013-9a9d-5517fd9c7e7d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:26.273704 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-8e5a6eff-73f1-41a1-94e5-8bd0be3f2dae tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:26.299813 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-8e5a6eff-73f1-41a1-94e5-8bd0be3f2dae tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1226 microversion: 2.1 time: 0.403734 Sep 23 15:20:26.321561 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 27/42] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:25 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1226 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:26.414935 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-d528b51b-17ef-4013-9a9d-5517fd9c7e7d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:26.416096 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-362ed9f1-793d-4b38-9def-6cae41828754 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:26.417178 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-362ed9f1-793d-4b38-9def-6cae41828754 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:26.438672 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-362ed9f1-793d-4b38-9def-6cae41828754 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:26.438672 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-362ed9f1-793d-4b38-9def-6cae41828754 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:26.438672 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-362ed9f1-793d-4b38-9def-6cae41828754 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:26.441469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-362ed9f1-793d-4b38-9def-6cae41828754 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:26.442454 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-d528b51b-17ef-4013-9a9d-5517fd9c7e7d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1214 microversion: 2.1 time: 0.235869 Sep 23 15:20:26.445652 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-362ed9f1-793d-4b38-9def-6cae41828754 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:26.446416 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-362ed9f1-793d-4b38-9def-6cae41828754 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:26.457467 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 16/43] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:26 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1214 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:26.625377 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-362ed9f1-793d-4b38-9def-6cae41828754 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:26.635202 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-362ed9f1-793d-4b38-9def-6cae41828754 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1241 microversion: 2.1 time: 0.225822 Sep 23 15:20:26.636857 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 28/44] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:26 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1241 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:27.106566 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-493e4477-c2c1-4735-b3a3-5c687fd4b59a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1101942019", "imageRef": "051c4746-7f50-4edb-b09d-a8935df360de", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9884c67-117e-4e2a-8424-37edb233007d"}], "security_groups": [{"name": "tempest-securitygroup--1246397581"}], "key_name": "tempest-keypair-2038150903", "user_data": "}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:20:27.331637 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-c4712ce6-b689-4090-8890-d3c32df1c7a6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:27.334645 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-c4712ce6-b689-4090-8890-d3c32df1c7a6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:27.339745 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c4712ce6-b689-4090-8890-d3c32df1c7a6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:27.341587 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c4712ce6-b689-4090-8890-d3c32df1c7a6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:27.343302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c4712ce6-b689-4090-8890-d3c32df1c7a6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:27.344088 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c4712ce6-b689-4090-8890-d3c32df1c7a6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:27.344562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c4712ce6-b689-4090-8890-d3c32df1c7a6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:27.344998 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c4712ce6-b689-4090-8890-d3c32df1c7a6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:27.348165 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.network.neutron [None req-493e4477-c2c1-4735-b3a3-5c687fd4b59a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] validate_networks() for [('b9884c67-117e-4e2a-8424-37edb233007d', None, None, None, None, None)] {{(pid=121448) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:20:27.437532 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-c4712ce6-b689-4090-8890-d3c32df1c7a6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:27.448300 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-c4712ce6-b689-4090-8890-d3c32df1c7a6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1274 microversion: 2.1 time: 0.124254 Sep 23 15:20:27.449212 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 29/45] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:27 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1274 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:27.479523 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-ce251ca6-0d5d-45b7-b461-09d525d15c73 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:27.480253 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-ce251ca6-0d5d-45b7-b461-09d525d15c73 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:27.493044 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ce251ca6-0d5d-45b7-b461-09d525d15c73 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:27.494925 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ce251ca6-0d5d-45b7-b461-09d525d15c73 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:27.496771 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ce251ca6-0d5d-45b7-b461-09d525d15c73 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:27.502011 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ce251ca6-0d5d-45b7-b461-09d525d15c73 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:27.502613 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ce251ca6-0d5d-45b7-b461-09d525d15c73 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:27.503069 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ce251ca6-0d5d-45b7-b461-09d525d15c73 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:27.599650 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-ce251ca6-0d5d-45b7-b461-09d525d15c73 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:27.608727 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-ce251ca6-0d5d-45b7-b461-09d525d15c73 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1218 microversion: 2.1 time: 0.137565 Sep 23 15:20:27.609416 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 30/46] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:27 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1218 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:27.661507 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-7989e65c-3ab1-418f-9bd7-9278ad5d8177 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:27.662243 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-7989e65c-3ab1-418f-9bd7-9278ad5d8177 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:27.668859 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7989e65c-3ab1-418f-9bd7-9278ad5d8177 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:27.669561 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7989e65c-3ab1-418f-9bd7-9278ad5d8177 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:27.670096 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7989e65c-3ab1-418f-9bd7-9278ad5d8177 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:27.671101 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7989e65c-3ab1-418f-9bd7-9278ad5d8177 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:27.671640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7989e65c-3ab1-418f-9bd7-9278ad5d8177 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:27.672276 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7989e65c-3ab1-418f-9bd7-9278ad5d8177 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:27.737810 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-7989e65c-3ab1-418f-9bd7-9278ad5d8177 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:27.747442 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-7989e65c-3ab1-418f-9bd7-9278ad5d8177 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1233 microversion: 2.1 time: 0.090144 Sep 23 15:20:27.758311 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 31/47] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:27 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1233 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:27.877433 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-493e4477-c2c1-4735-b3a3-5c687fd4b59a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Flavor limits 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:20:27.877908 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-493e4477-c2c1-4735-b3a3-5c687fd4b59a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Image limits 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:20:27.878328 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-493e4477-c2c1-4735-b3a3-5c687fd4b59a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Flavor pref 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:20:27.878768 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-493e4477-c2c1-4735-b3a3-5c687fd4b59a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Image pref 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:20:27.879178 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-493e4477-c2c1-4735-b3a3-5c687fd4b59a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:20:27.888405 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-493e4477-c2c1-4735-b3a3-5c687fd4b59a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:27.888889 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-493e4477-c2c1-4735-b3a3-5c687fd4b59a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:27.889322 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-493e4477-c2c1-4735-b3a3-5c687fd4b59a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:27.890048 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-493e4477-c2c1-4735-b3a3-5c687fd4b59a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:27.890501 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-493e4477-c2c1-4735-b3a3-5c687fd4b59a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:27.891196 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-493e4477-c2c1-4735-b3a3-5c687fd4b59a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:27.907824 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-493e4477-c2c1-4735-b3a3-5c687fd4b59a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Getting quotas for project 1679242155f94d48871525425f74d1c3. Resources: {'ram', 'instances', 'cores'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:20:27.911563 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-493e4477-c2c1-4735-b3a3-5c687fd4b59a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Getting quotas for user 42dc378333ae4bbdbd42ce041ba15d3f and project 1679242155f94d48871525425f74d1c3. Resources: {'ram', 'instances', 'cores'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:20:27.922663 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-493e4477-c2c1-4735-b3a3-5c687fd4b59a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Going to run 1 instances... {{(pid=121448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:20:27.924848 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-493e4477-c2c1-4735-b3a3-5c687fd4b59a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='051c4746-7f50-4edb-b09d-a8935df360de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:20:28.490695 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-df167cc3-ade0-404f-abd0-4b50648c842f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:28.491316 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-df167cc3-ade0-404f-abd0-4b50648c842f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:28.497461 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-df167cc3-ade0-404f-abd0-4b50648c842f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:28.497951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-df167cc3-ade0-404f-abd0-4b50648c842f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:28.498394 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-df167cc3-ade0-404f-abd0-4b50648c842f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:28.499090 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-df167cc3-ade0-404f-abd0-4b50648c842f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:28.499551 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-df167cc3-ade0-404f-abd0-4b50648c842f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:28.500010 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-df167cc3-ade0-404f-abd0-4b50648c842f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:28.563501 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-df167cc3-ade0-404f-abd0-4b50648c842f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:28.585898 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-493e4477-c2c1-4735-b3a3-5c687fd4b59a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.484481 Sep 23 15:20:28.586254 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-df167cc3-ade0-404f-abd0-4b50648c842f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1274 microversion: 2.1 time: 0.099476 Sep 23 15:20:28.598684 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 17/48] 10.222.0.55 () {62 vars in 1188 bytes} [Fri Sep 23 15:20:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 1486 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 15:20:28.598994 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 32/49] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:28 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1274 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:28.621729 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-cf4d5348-6f89-4a40-8192-ff732cc7e60f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:28.621729 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-cf4d5348-6f89-4a40-8192-ff732cc7e60f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:28.634234 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-7afadf88-fa82-4033-a831-06ed11143e42 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:28.635139 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-7afadf88-fa82-4033-a831-06ed11143e42 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:28.650386 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7afadf88-fa82-4033-a831-06ed11143e42 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:28.650931 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7afadf88-fa82-4033-a831-06ed11143e42 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:28.651407 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7afadf88-fa82-4033-a831-06ed11143e42 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:28.652157 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7afadf88-fa82-4033-a831-06ed11143e42 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:28.657504 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7afadf88-fa82-4033-a831-06ed11143e42 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:28.657966 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7afadf88-fa82-4033-a831-06ed11143e42 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:28.807036 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-7afadf88-fa82-4033-a831-06ed11143e42 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:28.819511 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-7afadf88-fa82-4033-a831-06ed11143e42 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1210 microversion: 2.1 time: 0.189581 Sep 23 15:20:28.822338 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 33/50] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:28 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1210 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:28.850049 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-cf4d5348-6f89-4a40-8192-ff732cc7e60f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:28.856525 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-2ca1f7ff-264e-43a2-ad2f-99fc27f995bf tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:28.861892 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-2ca1f7ff-264e-43a2-ad2f-99fc27f995bf tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:28.875674 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-cf4d5348-6f89-4a40-8192-ff732cc7e60f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:28.895972 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2ca1f7ff-264e-43a2-ad2f-99fc27f995bf tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:28.897205 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-cf4d5348-6f89-4a40-8192-ff732cc7e60f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:28.897682 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2ca1f7ff-264e-43a2-ad2f-99fc27f995bf tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:28.901816 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2ca1f7ff-264e-43a2-ad2f-99fc27f995bf tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:28.902202 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-cf4d5348-6f89-4a40-8192-ff732cc7e60f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1282 microversion: 2.20 time: 0.306098 Sep 23 15:20:28.903888 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2ca1f7ff-264e-43a2-ad2f-99fc27f995bf tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:28.905464 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 18/51] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:20:28 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1282 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:20:28.906120 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2ca1f7ff-264e-43a2-ad2f-99fc27f995bf tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:28.907866 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2ca1f7ff-264e-43a2-ad2f-99fc27f995bf tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:29.073776 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-2ca1f7ff-264e-43a2-ad2f-99fc27f995bf tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:29.094817 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-2ca1f7ff-264e-43a2-ad2f-99fc27f995bf tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1289 microversion: 2.1 time: 0.266550 Sep 23 15:20:29.096644 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 34/52] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:28 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1289 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:29.628333 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-03e8cd42-f688-4076-89d6-d4126922902d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:29.628996 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-03e8cd42-f688-4076-89d6-d4126922902d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:29.648070 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-03e8cd42-f688-4076-89d6-d4126922902d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:29.649015 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-03e8cd42-f688-4076-89d6-d4126922902d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:29.649800 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-03e8cd42-f688-4076-89d6-d4126922902d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:29.650824 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-03e8cd42-f688-4076-89d6-d4126922902d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:29.651427 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-03e8cd42-f688-4076-89d6-d4126922902d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:29.652548 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-03e8cd42-f688-4076-89d6-d4126922902d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:29.848886 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-c6c2cfbf-0451-45be-926c-bead67e436fd tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:29.850506 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-c6c2cfbf-0451-45be-926c-bead67e436fd tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:29.861308 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c6c2cfbf-0451-45be-926c-bead67e436fd tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:29.862157 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c6c2cfbf-0451-45be-926c-bead67e436fd tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:29.864252 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c6c2cfbf-0451-45be-926c-bead67e436fd tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:29.869490 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c6c2cfbf-0451-45be-926c-bead67e436fd tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:29.869490 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c6c2cfbf-0451-45be-926c-bead67e436fd tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:29.869490 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c6c2cfbf-0451-45be-926c-bead67e436fd tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:29.985312 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-c6c2cfbf-0451-45be-926c-bead67e436fd tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:30.000346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-c6c2cfbf-0451-45be-926c-bead67e436fd tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1210 microversion: 2.1 time: 0.159404 Sep 23 15:20:30.002561 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 35/53] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:29 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1210 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:30.025050 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b379ea1b-8eb5-42a4-b888-451278062073 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:30.026647 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-b379ea1b-8eb5-42a4-b888-451278062073 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:30.149663 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-03e8cd42-f688-4076-89d6-d4126922902d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:30.190414 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-03e8cd42-f688-4076-89d6-d4126922902d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1292 microversion: 2.1 time: 0.582064 Sep 23 15:20:30.204249 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 19/54] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:29 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1292 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:30.204347 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-b379ea1b-8eb5-42a4-b888-451278062073 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:30.208249 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-59bc4785-b7b6-4f5e-93cc-3c8b7a7d63f6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:30.210383 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-59bc4785-b7b6-4f5e-93cc-3c8b7a7d63f6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:30.219658 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-b379ea1b-8eb5-42a4-b888-451278062073 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:30.220255 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-59bc4785-b7b6-4f5e-93cc-3c8b7a7d63f6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:30.220785 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-59bc4785-b7b6-4f5e-93cc-3c8b7a7d63f6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:30.226777 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-b379ea1b-8eb5-42a4-b888-451278062073 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:30.254458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-59bc4785-b7b6-4f5e-93cc-3c8b7a7d63f6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:30.254756 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-b379ea1b-8eb5-42a4-b888-451278062073 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1282 microversion: 2.20 time: 0.229015 Sep 23 15:20:30.255044 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-59bc4785-b7b6-4f5e-93cc-3c8b7a7d63f6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:30.255044 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-59bc4785-b7b6-4f5e-93cc-3c8b7a7d63f6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:30.255298 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 36/55] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:20:30 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1282 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:20:30.255394 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-59bc4785-b7b6-4f5e-93cc-3c8b7a7d63f6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:30.633403 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-59bc4785-b7b6-4f5e-93cc-3c8b7a7d63f6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:30.675243 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-59bc4785-b7b6-4f5e-93cc-3c8b7a7d63f6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1289 microversion: 2.1 time: 0.477240 Sep 23 15:20:30.675869 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 20/56] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:30 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1289 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:31.029019 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-e59a15ed-93d8-4fbb-9154-622ab203422e tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:31.029933 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-e59a15ed-93d8-4fbb-9154-622ab203422e tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:31.040327 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e59a15ed-93d8-4fbb-9154-622ab203422e tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:31.040327 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e59a15ed-93d8-4fbb-9154-622ab203422e tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:31.040327 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e59a15ed-93d8-4fbb-9154-622ab203422e tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:31.042081 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e59a15ed-93d8-4fbb-9154-622ab203422e tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:31.042999 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e59a15ed-93d8-4fbb-9154-622ab203422e tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:31.043852 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e59a15ed-93d8-4fbb-9154-622ab203422e tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:31.128965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-e59a15ed-93d8-4fbb-9154-622ab203422e tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:31.138396 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-e59a15ed-93d8-4fbb-9154-622ab203422e tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1266 microversion: 2.1 time: 0.114194 Sep 23 15:20:31.139210 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 37/57] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:31 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1266 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:31.225607 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-aec738f7-6f01-4556-8fe0-647a7cb4b0ec tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:31.231608 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-aec738f7-6f01-4556-8fe0-647a7cb4b0ec tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:31.242418 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:31.249478 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-aec738f7-6f01-4556-8fe0-647a7cb4b0ec tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:31.250111 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-aec738f7-6f01-4556-8fe0-647a7cb4b0ec tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:31.250452 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-aec738f7-6f01-4556-8fe0-647a7cb4b0ec tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:31.251191 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-aec738f7-6f01-4556-8fe0-647a7cb4b0ec tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:31.251658 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-aec738f7-6f01-4556-8fe0-647a7cb4b0ec tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:31.252127 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-aec738f7-6f01-4556-8fe0-647a7cb4b0ec tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:31.276361 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-3c499018-c93d-44f6-b8c0-fd0b17cfd89f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:31.276986 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-3c499018-c93d-44f6-b8c0-fd0b17cfd89f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:31.433817 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-aec738f7-6f01-4556-8fe0-647a7cb4b0ec tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:31.444704 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-aec738f7-6f01-4556-8fe0-647a7cb4b0ec tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1280 microversion: 2.1 time: 0.230349 Sep 23 15:20:31.450433 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 21/58] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:31 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1280 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:31.473020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-3c499018-c93d-44f6-b8c0-fd0b17cfd89f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:31.486055 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-3c499018-c93d-44f6-b8c0-fd0b17cfd89f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:31.488121 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-3c499018-c93d-44f6-b8c0-fd0b17cfd89f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:31.489439 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-3c499018-c93d-44f6-b8c0-fd0b17cfd89f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1282 microversion: 2.20 time: 0.217207 Sep 23 15:20:31.490464 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 38/59] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:20:31 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1282 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:20:31.708498 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-813ad595-79c5-4ba1-8f0b-a7fd397cacfb tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:31.709513 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-813ad595-79c5-4ba1-8f0b-a7fd397cacfb tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:31.726579 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-813ad595-79c5-4ba1-8f0b-a7fd397cacfb tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:31.727481 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-813ad595-79c5-4ba1-8f0b-a7fd397cacfb tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:31.728196 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-813ad595-79c5-4ba1-8f0b-a7fd397cacfb tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:31.773155 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-813ad595-79c5-4ba1-8f0b-a7fd397cacfb tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:31.773155 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-813ad595-79c5-4ba1-8f0b-a7fd397cacfb tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:31.773155 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-813ad595-79c5-4ba1-8f0b-a7fd397cacfb tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:31.873775 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-813ad595-79c5-4ba1-8f0b-a7fd397cacfb tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:31.884559 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-813ad595-79c5-4ba1-8f0b-a7fd397cacfb tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1307 microversion: 2.1 time: 0.185379 Sep 23 15:20:31.885161 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 22/60] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:31 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1307 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:32.164855 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b0c23309-b362-44ee-b9b5-668d98bae3ac tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:32.166464 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-b0c23309-b362-44ee-b9b5-668d98bae3ac tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:32.185353 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b0c23309-b362-44ee-b9b5-668d98bae3ac tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:32.186794 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b0c23309-b362-44ee-b9b5-668d98bae3ac tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:32.194684 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b0c23309-b362-44ee-b9b5-668d98bae3ac tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:32.196247 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b0c23309-b362-44ee-b9b5-668d98bae3ac tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:32.197057 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b0c23309-b362-44ee-b9b5-668d98bae3ac tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:32.200563 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b0c23309-b362-44ee-b9b5-668d98bae3ac tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:32.475385 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-19d6a7b7-5d13-42a0-b3d9-e9f726b16f2d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:32.478549 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-19d6a7b7-5d13-42a0-b3d9-e9f726b16f2d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:32.490196 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-19d6a7b7-5d13-42a0-b3d9-e9f726b16f2d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:32.490684 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-19d6a7b7-5d13-42a0-b3d9-e9f726b16f2d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:32.491179 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-19d6a7b7-5d13-42a0-b3d9-e9f726b16f2d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:32.491877 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-19d6a7b7-5d13-42a0-b3d9-e9f726b16f2d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:32.492409 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-19d6a7b7-5d13-42a0-b3d9-e9f726b16f2d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:32.492840 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-19d6a7b7-5d13-42a0-b3d9-e9f726b16f2d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:32.874134 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-b0c23309-b362-44ee-b9b5-668d98bae3ac tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:32.883441 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell0:SELECT=2 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:32.892076 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-b0c23309-b362-44ee-b9b5-668d98bae3ac tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1266 microversion: 2.1 time: 0.732119 Sep 23 15:20:32.893535 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 39/61] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:32 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1266 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:32.910716 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-d95ce622-fd0d-46a1-8d7e-00bd6ab30981 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:32.911607 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-d95ce622-fd0d-46a1-8d7e-00bd6ab30981 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:32.929643 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d95ce622-fd0d-46a1-8d7e-00bd6ab30981 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:32.930499 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d95ce622-fd0d-46a1-8d7e-00bd6ab30981 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:32.931193 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d95ce622-fd0d-46a1-8d7e-00bd6ab30981 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:32.932262 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d95ce622-fd0d-46a1-8d7e-00bd6ab30981 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:32.932975 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d95ce622-fd0d-46a1-8d7e-00bd6ab30981 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:32.933923 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d95ce622-fd0d-46a1-8d7e-00bd6ab30981 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:33.097141 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-19d6a7b7-5d13-42a0-b3d9-e9f726b16f2d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:33.110087 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-19d6a7b7-5d13-42a0-b3d9-e9f726b16f2d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1322 microversion: 2.1 time: 0.638893 Sep 23 15:20:33.142112 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 23/62] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:32 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1322 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:33.147649 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-ada7e134-b4c8-4213-85e6-45b2639c6ec6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:33.165965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-d95ce622-fd0d-46a1-8d7e-00bd6ab30981 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:33.169957 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-ada7e134-b4c8-4213-85e6-45b2639c6ec6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:33.176805 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-d95ce622-fd0d-46a1-8d7e-00bd6ab30981 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:33.184928 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-d95ce622-fd0d-46a1-8d7e-00bd6ab30981 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:33.187961 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ada7e134-b4c8-4213-85e6-45b2639c6ec6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:33.189788 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ada7e134-b4c8-4213-85e6-45b2639c6ec6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:33.190189 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ada7e134-b4c8-4213-85e6-45b2639c6ec6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:33.191009 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ada7e134-b4c8-4213-85e6-45b2639c6ec6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:33.192512 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ada7e134-b4c8-4213-85e6-45b2639c6ec6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:33.192512 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ada7e134-b4c8-4213-85e6-45b2639c6ec6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:33.201015 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-d95ce622-fd0d-46a1-8d7e-00bd6ab30981 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1286 microversion: 2.20 time: 0.303499 Sep 23 15:20:33.221404 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 40/63] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:20:32 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1286 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:20:33.647401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-ada7e134-b4c8-4213-85e6-45b2639c6ec6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:33.663185 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-ada7e134-b4c8-4213-85e6-45b2639c6ec6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1363 microversion: 2.1 time: 0.519555 Sep 23 15:20:33.673042 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 24/64] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:33 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1363 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:33.922390 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-274b6381-b3b3-48ef-a6bc-698ae9fda6e8 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:33.923377 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-274b6381-b3b3-48ef-a6bc-698ae9fda6e8 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:33.936544 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-274b6381-b3b3-48ef-a6bc-698ae9fda6e8 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:33.937427 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-274b6381-b3b3-48ef-a6bc-698ae9fda6e8 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:33.938259 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-274b6381-b3b3-48ef-a6bc-698ae9fda6e8 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:33.940034 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-274b6381-b3b3-48ef-a6bc-698ae9fda6e8 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:33.941049 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-274b6381-b3b3-48ef-a6bc-698ae9fda6e8 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:33.941652 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-274b6381-b3b3-48ef-a6bc-698ae9fda6e8 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:34.166685 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-7b2f1967-279f-4cb9-9fe6-55d4a37a7e49 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:34.169693 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-7b2f1967-279f-4cb9-9fe6-55d4a37a7e49 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:34.184528 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7b2f1967-279f-4cb9-9fe6-55d4a37a7e49 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:34.185402 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7b2f1967-279f-4cb9-9fe6-55d4a37a7e49 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:34.186037 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7b2f1967-279f-4cb9-9fe6-55d4a37a7e49 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:34.187037 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7b2f1967-279f-4cb9-9fe6-55d4a37a7e49 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:34.188297 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7b2f1967-279f-4cb9-9fe6-55d4a37a7e49 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:34.190290 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7b2f1967-279f-4cb9-9fe6-55d4a37a7e49 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:34.241166 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-274b6381-b3b3-48ef-a6bc-698ae9fda6e8 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:34.281686 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-274b6381-b3b3-48ef-a6bc-698ae9fda6e8 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1272 microversion: 2.1 time: 0.358296 Sep 23 15:20:34.283527 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 41/65] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:33 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1272 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:34.333458 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-67140783-b889-469e-957d-6fa2878f7557 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:34.334903 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-67140783-b889-469e-957d-6fa2878f7557 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:34.355217 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-67140783-b889-469e-957d-6fa2878f7557 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:34.357981 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-67140783-b889-469e-957d-6fa2878f7557 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:34.358773 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-67140783-b889-469e-957d-6fa2878f7557 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:34.362527 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-67140783-b889-469e-957d-6fa2878f7557 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:34.364288 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-67140783-b889-469e-957d-6fa2878f7557 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:34.366012 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-67140783-b889-469e-957d-6fa2878f7557 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:34.852721 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-67140783-b889-469e-957d-6fa2878f7557 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:34.866511 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-67140783-b889-469e-957d-6fa2878f7557 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:34.875956 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-67140783-b889-469e-957d-6fa2878f7557 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:34.884900 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-67140783-b889-469e-957d-6fa2878f7557 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1334 microversion: 2.20 time: 0.574431 Sep 23 15:20:34.907500 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 42/66] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:20:34 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1334 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:20:35.033387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-b652d8a3-6286-4dd8-a5ca-a35d16838fcd req-98d68f83-b8a8-4d38-a88e-a01002620499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53291dd1-3df2-438e-a2aa-80fa4e76245c", "tag": "0ac971ff-aa73-4c23-905e-b603461ad30f"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:20:35.062805 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-b652d8a3-6286-4dd8-a5ca-a35d16838fcd req-98d68f83-b8a8-4d38-a88e-a01002620499 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:35.063665 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-b652d8a3-6286-4dd8-a5ca-a35d16838fcd req-98d68f83-b8a8-4d38-a88e-a01002620499 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:35.065785 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-b652d8a3-6286-4dd8-a5ca-a35d16838fcd req-98d68f83-b8a8-4d38-a88e-a01002620499 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:35.094762 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-7b2f1967-279f-4cb9-9fe6-55d4a37a7e49 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:35.104884 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-7b2f1967-279f-4cb9-9fe6-55d4a37a7e49 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1322 microversion: 2.1 time: 0.946010 Sep 23 15:20:35.107295 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 25/67] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:34 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1322 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:35.120353 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-f7a7b99c-6255-431a-b978-f8126807e4c7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:35.121446 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-f7a7b99c-6255-431a-b978-f8126807e4c7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:35.128116 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-b652d8a3-6286-4dd8-a5ca-a35d16838fcd req-98d68f83-b8a8-4d38-a88e-a01002620499 service nova] Creating event network-changed:0ac971ff-aa73-4c23-905e-b603461ad30f for instance 53291dd1-3df2-438e-a2aa-80fa4e76245c on hv-cinder-85530 Sep 23 15:20:35.128931 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-b652d8a3-6286-4dd8-a5ca-a35d16838fcd req-98d68f83-b8a8-4d38-a88e-a01002620499 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 15:20:35.130568 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-b652d8a3-6286-4dd8-a5ca-a35d16838fcd req-98d68f83-b8a8-4d38-a88e-a01002620499 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 15:20:35.133666 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f7a7b99c-6255-431a-b978-f8126807e4c7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:35.134279 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f72402f4-38a4-441b-acef-2604d1763751 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:35.134658 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f7a7b99c-6255-431a-b978-f8126807e4c7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:35.134850 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f72402f4-38a4-441b-acef-2604d1763751 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:35.135355 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f72402f4-38a4-441b-acef-2604d1763751 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:35.135636 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f7a7b99c-6255-431a-b978-f8126807e4c7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:35.136214 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f72402f4-38a4-441b-acef-2604d1763751 None None] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:35.137913 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f7a7b99c-6255-431a-b978-f8126807e4c7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:35.138630 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f7a7b99c-6255-431a-b978-f8126807e4c7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:35.139274 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f7a7b99c-6255-431a-b978-f8126807e4c7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:35.139658 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f72402f4-38a4-441b-acef-2604d1763751 None None] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:35.141828 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f72402f4-38a4-441b-acef-2604d1763751 None None] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:35.157970 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.compute.rpcapi [None req-f72402f4-38a4-441b-acef-2604d1763751 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 23 15:20:35.158807 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f72402f4-38a4-441b-acef-2604d1763751 None None] Releasing lock "compute-rpcapi-router" {{(pid=121450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 15:20:35.185060 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-f72402f4-38a4-441b-acef-2604d1763751 None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.276076 Sep 23 15:20:35.186023 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 43/68] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:20:35.313272 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-746d796e-4176-41ea-9a00-f1084d8bd754 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:35.315174 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-746d796e-4176-41ea-9a00-f1084d8bd754 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:35.337323 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-746d796e-4176-41ea-9a00-f1084d8bd754 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:35.337828 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-746d796e-4176-41ea-9a00-f1084d8bd754 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:35.338263 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-746d796e-4176-41ea-9a00-f1084d8bd754 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:35.338982 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-746d796e-4176-41ea-9a00-f1084d8bd754 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:35.342641 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-746d796e-4176-41ea-9a00-f1084d8bd754 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:35.343344 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-746d796e-4176-41ea-9a00-f1084d8bd754 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:35.544107 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-f7a7b99c-6255-431a-b978-f8126807e4c7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:35.553562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-f7a7b99c-6255-431a-b978-f8126807e4c7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1363 microversion: 2.1 time: 0.444980 Sep 23 15:20:35.560423 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 26/69] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:35 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1363 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:35.787416 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-746d796e-4176-41ea-9a00-f1084d8bd754 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:35.796533 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-746d796e-4176-41ea-9a00-f1084d8bd754 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1314 microversion: 2.1 time: 0.488069 Sep 23 15:20:35.801708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 44/70] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:35 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:35.921198 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-cd233097-0334-4880-985a-acc0df664abe tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:35.922129 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-cd233097-0334-4880-985a-acc0df664abe tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:35.935394 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-cd233097-0334-4880-985a-acc0df664abe tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:35.936359 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-cd233097-0334-4880-985a-acc0df664abe tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:35.937005 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-cd233097-0334-4880-985a-acc0df664abe tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:35.943652 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-cd233097-0334-4880-985a-acc0df664abe tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:35.944571 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-cd233097-0334-4880-985a-acc0df664abe tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:35.945269 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-cd233097-0334-4880-985a-acc0df664abe tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:36.131755 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-5babd84e-43c9-4ff4-a685-a04ed9d1d4d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:36.132545 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-5babd84e-43c9-4ff4-a685-a04ed9d1d4d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:36.140001 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5babd84e-43c9-4ff4-a685-a04ed9d1d4d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:36.140914 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5babd84e-43c9-4ff4-a685-a04ed9d1d4d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:36.141470 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5babd84e-43c9-4ff4-a685-a04ed9d1d4d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:36.142238 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5babd84e-43c9-4ff4-a685-a04ed9d1d4d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:36.142801 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5babd84e-43c9-4ff4-a685-a04ed9d1d4d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:36.143296 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5babd84e-43c9-4ff4-a685-a04ed9d1d4d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:36.171396 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-cd233097-0334-4880-985a-acc0df664abe tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:36.184123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=100 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:36.189442 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-cd233097-0334-4880-985a-acc0df664abe tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:36.191661 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-cd233097-0334-4880-985a-acc0df664abe tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:36.193267 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-cd233097-0334-4880-985a-acc0df664abe tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1342 microversion: 2.20 time: 0.276458 Sep 23 15:20:36.200563 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 27/71] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:20:35 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1342 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:20:36.587088 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-dc85e9de-aca0-4818-9f2a-2fe430085dee tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:36.587696 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-dc85e9de-aca0-4818-9f2a-2fe430085dee tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:36.598488 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dc85e9de-aca0-4818-9f2a-2fe430085dee tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:36.599365 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dc85e9de-aca0-4818-9f2a-2fe430085dee tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:36.600021 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dc85e9de-aca0-4818-9f2a-2fe430085dee tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:36.601724 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dc85e9de-aca0-4818-9f2a-2fe430085dee tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:36.602638 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dc85e9de-aca0-4818-9f2a-2fe430085dee tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:36.603222 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dc85e9de-aca0-4818-9f2a-2fe430085dee tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:36.810561 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-5babd84e-43c9-4ff4-a685-a04ed9d1d4d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:36.819817 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-5babd84e-43c9-4ff4-a685-a04ed9d1d4d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1322 microversion: 2.1 time: 0.692772 Sep 23 15:20:36.829095 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 45/72] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:36 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1322 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:36.843336 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-14b19d5f-7c2f-4708-bb7e-f86d2f82da27 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:36.843951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-14b19d5f-7c2f-4708-bb7e-f86d2f82da27 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:36.864297 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-14b19d5f-7c2f-4708-bb7e-f86d2f82da27 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:36.865099 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-14b19d5f-7c2f-4708-bb7e-f86d2f82da27 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:36.865665 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-dc85e9de-aca0-4818-9f2a-2fe430085dee tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:36.865805 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-14b19d5f-7c2f-4708-bb7e-f86d2f82da27 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:36.869212 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-14b19d5f-7c2f-4708-bb7e-f86d2f82da27 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:36.869685 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-14b19d5f-7c2f-4708-bb7e-f86d2f82da27 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:36.870115 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-14b19d5f-7c2f-4708-bb7e-f86d2f82da27 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:36.879026 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-dc85e9de-aca0-4818-9f2a-2fe430085dee tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1363 microversion: 2.1 time: 0.295651 Sep 23 15:20:36.893573 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 28/73] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:36 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1363 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:37.227316 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-028e9aa5-ce87-4ed0-9143-48d3794bc5cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:37.230612 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-028e9aa5-ce87-4ed0-9143-48d3794bc5cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:37.258007 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-028e9aa5-ce87-4ed0-9143-48d3794bc5cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:37.258993 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-028e9aa5-ce87-4ed0-9143-48d3794bc5cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:37.263047 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-028e9aa5-ce87-4ed0-9143-48d3794bc5cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:37.264210 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-028e9aa5-ce87-4ed0-9143-48d3794bc5cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:37.267739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-028e9aa5-ce87-4ed0-9143-48d3794bc5cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:37.268564 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-028e9aa5-ce87-4ed0-9143-48d3794bc5cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:37.595217 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-028e9aa5-ce87-4ed0-9143-48d3794bc5cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:37.613395 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-028e9aa5-ce87-4ed0-9143-48d3794bc5cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:37.615376 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-028e9aa5-ce87-4ed0-9143-48d3794bc5cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:37.616806 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-028e9aa5-ce87-4ed0-9143-48d3794bc5cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1342 microversion: 2.20 time: 0.393655 Sep 23 15:20:37.640496 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 29/74] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:20:37 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1342 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:20:37.645731 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-5b708e0c-559b-4873-8201-cd2dd8c0e537 req-91f392b2-deaf-4fa1-a09b-1a540a126e51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e7c6dbd-a4f4-4fd8-a719-38705c323809", "tag": "d891c01a-6a8c-4f04-ae61-1c13c3cb2ed1"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:20:37.671800 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-5b708e0c-559b-4873-8201-cd2dd8c0e537 req-91f392b2-deaf-4fa1-a09b-1a540a126e51 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:37.672585 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-5b708e0c-559b-4873-8201-cd2dd8c0e537 req-91f392b2-deaf-4fa1-a09b-1a540a126e51 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:37.674157 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-5b708e0c-559b-4873-8201-cd2dd8c0e537 req-91f392b2-deaf-4fa1-a09b-1a540a126e51 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:37.717414 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-5b708e0c-559b-4873-8201-cd2dd8c0e537 req-91f392b2-deaf-4fa1-a09b-1a540a126e51 service nova] Creating event network-changed:d891c01a-6a8c-4f04-ae61-1c13c3cb2ed1 for instance 3e7c6dbd-a4f4-4fd8-a719-38705c323809 on hv-cinder-85530 Sep 23 15:20:37.718217 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-5b708e0c-559b-4873-8201-cd2dd8c0e537 req-91f392b2-deaf-4fa1-a09b-1a540a126e51 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121448) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 15:20:37.718769 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-5b708e0c-559b-4873-8201-cd2dd8c0e537 req-91f392b2-deaf-4fa1-a09b-1a540a126e51 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121448) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 15:20:37.720096 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-81b17667-2af9-4873-a156-aecb17f7b196 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:37.720895 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-81b17667-2af9-4873-a156-aecb17f7b196 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:37.732474 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-81b17667-2af9-4873-a156-aecb17f7b196 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:37.733807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-81b17667-2af9-4873-a156-aecb17f7b196 None None] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:37.734525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-81b17667-2af9-4873-a156-aecb17f7b196 None None] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:37.735187 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-81b17667-2af9-4873-a156-aecb17f7b196 None None] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:37.737668 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-14b19d5f-7c2f-4708-bb7e-f86d2f82da27 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:37.746683 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-14b19d5f-7c2f-4708-bb7e-f86d2f82da27 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1314 microversion: 2.1 time: 0.916367 Sep 23 15:20:37.749884 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 46/75] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:36 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1314 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:37.756319 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.compute.rpcapi [None req-81b17667-2af9-4873-a156-aecb17f7b196 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 23 15:20:37.764238 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-81b17667-2af9-4873-a156-aecb17f7b196 None None] Releasing lock "compute-rpcapi-router" {{(pid=121448) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 15:20:37.795434 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-81b17667-2af9-4873-a156-aecb17f7b196 None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153232 Sep 23 15:20:37.796266 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 30/76] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:20:37.845089 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-e8f45c05-31bd-4a0c-b2eb-08ed5847577e req-1ecedc34-f5b0-4fe9-8497-c428b6de4119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c5523ab-9085-47cd-9133-f65554b59f0f", "tag": "55424de1-677b-4c57-a21b-d9eb905f5fc7"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:20:37.859276 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-17287661-e2e8-4410-9684-d120cb63b920 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:37.860353 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-17287661-e2e8-4410-9684-d120cb63b920 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:37.866920 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-e8f45c05-31bd-4a0c-b2eb-08ed5847577e req-1ecedc34-f5b0-4fe9-8497-c428b6de4119 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:37.868672 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-e8f45c05-31bd-4a0c-b2eb-08ed5847577e req-1ecedc34-f5b0-4fe9-8497-c428b6de4119 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:37.869119 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-e8f45c05-31bd-4a0c-b2eb-08ed5847577e req-1ecedc34-f5b0-4fe9-8497-c428b6de4119 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:37.878305 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-17287661-e2e8-4410-9684-d120cb63b920 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:37.878876 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-17287661-e2e8-4410-9684-d120cb63b920 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:37.879325 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-17287661-e2e8-4410-9684-d120cb63b920 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:37.880137 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-17287661-e2e8-4410-9684-d120cb63b920 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:37.880602 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-17287661-e2e8-4410-9684-d120cb63b920 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:37.881035 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-17287661-e2e8-4410-9684-d120cb63b920 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:37.902975 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-e8f45c05-31bd-4a0c-b2eb-08ed5847577e req-1ecedc34-f5b0-4fe9-8497-c428b6de4119 service nova] Creating event network-changed:55424de1-677b-4c57-a21b-d9eb905f5fc7 for instance 1c5523ab-9085-47cd-9133-f65554b59f0f on hv-cinder-85530 Sep 23 15:20:37.941846 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-e8f45c05-31bd-4a0c-b2eb-08ed5847577e req-1ecedc34-f5b0-4fe9-8497-c428b6de4119 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188757 Sep 23 15:20:37.951798 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 47/77] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:20:37.966908 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-73867b0e-cbfe-46c8-975e-c724eb80e9c6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:37.970072 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-73867b0e-cbfe-46c8-975e-c724eb80e9c6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:37.987922 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-73867b0e-cbfe-46c8-975e-c724eb80e9c6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:37.990688 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-73867b0e-cbfe-46c8-975e-c724eb80e9c6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:37.995283 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-73867b0e-cbfe-46c8-975e-c724eb80e9c6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:37.997257 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-73867b0e-cbfe-46c8-975e-c724eb80e9c6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:37.999077 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-73867b0e-cbfe-46c8-975e-c724eb80e9c6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:38.000755 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-73867b0e-cbfe-46c8-975e-c724eb80e9c6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:38.539835 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-17287661-e2e8-4410-9684-d120cb63b920 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:38.554079 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-17287661-e2e8-4410-9684-d120cb63b920 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1322 microversion: 2.1 time: 0.708667 Sep 23 15:20:38.555347 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 31/78] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:37 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1322 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:38.564813 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-73867b0e-cbfe-46c8-975e-c724eb80e9c6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:38.579618 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-73867b0e-cbfe-46c8-975e-c724eb80e9c6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1363 microversion: 2.1 time: 0.631842 Sep 23 15:20:38.580305 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 48/79] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:37 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1363 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:38.645342 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-00102ace-b5f4-426a-82fd-062488fdbc24 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:38.645956 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-00102ace-b5f4-426a-82fd-062488fdbc24 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:38.654118 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-00102ace-b5f4-426a-82fd-062488fdbc24 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:38.654618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-00102ace-b5f4-426a-82fd-062488fdbc24 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:38.655137 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-00102ace-b5f4-426a-82fd-062488fdbc24 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:38.655929 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-00102ace-b5f4-426a-82fd-062488fdbc24 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:38.656484 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-00102ace-b5f4-426a-82fd-062488fdbc24 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:38.656994 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-00102ace-b5f4-426a-82fd-062488fdbc24 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:38.775090 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a9ec0338-948c-42bd-8600-8ee64c44f829 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:38.775703 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-a9ec0338-948c-42bd-8600-8ee64c44f829 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:38.788390 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a9ec0338-948c-42bd-8600-8ee64c44f829 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:38.790722 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a9ec0338-948c-42bd-8600-8ee64c44f829 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:38.791343 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a9ec0338-948c-42bd-8600-8ee64c44f829 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:38.793867 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a9ec0338-948c-42bd-8600-8ee64c44f829 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:38.797905 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a9ec0338-948c-42bd-8600-8ee64c44f829 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:38.798558 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a9ec0338-948c-42bd-8600-8ee64c44f829 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:38.868869 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell0:SELECT=36 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:38.907270 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-00102ace-b5f4-426a-82fd-062488fdbc24 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:38.926384 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-00102ace-b5f4-426a-82fd-062488fdbc24 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:38.926384 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-00102ace-b5f4-426a-82fd-062488fdbc24 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:38.926384 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-00102ace-b5f4-426a-82fd-062488fdbc24 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1352 microversion: 2.20 time: 0.278255 Sep 23 15:20:38.926991 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 32/80] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:20:38 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1352 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:20:39.172972 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a9ec0338-948c-42bd-8600-8ee64c44f829 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:39.189595 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-a9ec0338-948c-42bd-8600-8ee64c44f829 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1314 microversion: 2.1 time: 0.418715 Sep 23 15:20:39.190825 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 49/81] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:38 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:39.587422 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-984854e2-5f9b-4ce8-aa10-c8f940e9ba99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:39.588094 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-984854e2-5f9b-4ce8-aa10-c8f940e9ba99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:39.595651 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-984854e2-5f9b-4ce8-aa10-c8f940e9ba99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:39.596532 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-984854e2-5f9b-4ce8-aa10-c8f940e9ba99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:39.606462 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-984854e2-5f9b-4ce8-aa10-c8f940e9ba99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:39.606698 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-e65c56f6-0555-44fe-83ee-b3378cadab14 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:39.607194 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-e65c56f6-0555-44fe-83ee-b3378cadab14 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:39.607775 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-984854e2-5f9b-4ce8-aa10-c8f940e9ba99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:39.608297 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-984854e2-5f9b-4ce8-aa10-c8f940e9ba99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:39.608794 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-984854e2-5f9b-4ce8-aa10-c8f940e9ba99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:39.616651 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e65c56f6-0555-44fe-83ee-b3378cadab14 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:39.619682 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e65c56f6-0555-44fe-83ee-b3378cadab14 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:39.619682 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e65c56f6-0555-44fe-83ee-b3378cadab14 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:39.619923 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e65c56f6-0555-44fe-83ee-b3378cadab14 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:39.622793 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e65c56f6-0555-44fe-83ee-b3378cadab14 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:39.623297 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e65c56f6-0555-44fe-83ee-b3378cadab14 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:39.835216 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-984854e2-5f9b-4ce8-aa10-c8f940e9ba99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:39.845015 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-984854e2-5f9b-4ce8-aa10-c8f940e9ba99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1322 microversion: 2.1 time: 0.261322 Sep 23 15:20:39.861494 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 33/82] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:39 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:39.948637 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-ec0f63e5-2d6e-447a-96c4-60073ebd7c68 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:39.949533 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-ec0f63e5-2d6e-447a-96c4-60073ebd7c68 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:39.958758 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ec0f63e5-2d6e-447a-96c4-60073ebd7c68 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:39.959434 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ec0f63e5-2d6e-447a-96c4-60073ebd7c68 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:39.959717 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ec0f63e5-2d6e-447a-96c4-60073ebd7c68 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:39.960426 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ec0f63e5-2d6e-447a-96c4-60073ebd7c68 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:39.960888 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ec0f63e5-2d6e-447a-96c4-60073ebd7c68 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:39.961316 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ec0f63e5-2d6e-447a-96c4-60073ebd7c68 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:39.988014 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=100 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:40.013011 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-e65c56f6-0555-44fe-83ee-b3378cadab14 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:40.031600 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-e65c56f6-0555-44fe-83ee-b3378cadab14 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1363 microversion: 2.1 time: 0.429534 Sep 23 15:20:40.032974 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 50/83] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:39 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1363 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:40.244354 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-825417cd-1e92-4d13-84a7-2fd0d34b05a6 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:40.245005 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-825417cd-1e92-4d13-84a7-2fd0d34b05a6 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:40.251918 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:40.265426 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-825417cd-1e92-4d13-84a7-2fd0d34b05a6 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:40.265930 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-825417cd-1e92-4d13-84a7-2fd0d34b05a6 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:40.266371 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-825417cd-1e92-4d13-84a7-2fd0d34b05a6 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:40.267079 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-825417cd-1e92-4d13-84a7-2fd0d34b05a6 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:40.267530 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-825417cd-1e92-4d13-84a7-2fd0d34b05a6 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:40.278889 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-825417cd-1e92-4d13-84a7-2fd0d34b05a6 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:40.324693 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-ec0f63e5-2d6e-447a-96c4-60073ebd7c68 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:40.338972 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-ec0f63e5-2d6e-447a-96c4-60073ebd7c68 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:40.341605 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-ec0f63e5-2d6e-447a-96c4-60073ebd7c68 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:40.342747 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-ec0f63e5-2d6e-447a-96c4-60073ebd7c68 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1408 microversion: 2.20 time: 0.398509 Sep 23 15:20:40.343351 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 34/84] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:20:39 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1408 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:20:40.410284 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-dbab500c-d211-4cfd-9e47-583f49bc954e req-5f15198d-45d9-422b-9a60-dcf168ab7752 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "878c924c-fcc8-4dbf-8ea1-132f142e0422", "tag": "fdb860b5-e215-4e14-8b93-274f42416008"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:20:40.420616 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-dbab500c-d211-4cfd-9e47-583f49bc954e req-5f15198d-45d9-422b-9a60-dcf168ab7752 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:40.421091 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-dbab500c-d211-4cfd-9e47-583f49bc954e req-5f15198d-45d9-422b-9a60-dcf168ab7752 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:40.421815 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-dbab500c-d211-4cfd-9e47-583f49bc954e req-5f15198d-45d9-422b-9a60-dcf168ab7752 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:40.434648 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-dbab500c-d211-4cfd-9e47-583f49bc954e req-5f15198d-45d9-422b-9a60-dcf168ab7752 service nova] Creating event network-changed:fdb860b5-e215-4e14-8b93-274f42416008 for instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 on hv-cinder-85530 Sep 23 15:20:40.439895 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-dbab500c-d211-4cfd-9e47-583f49bc954e req-5f15198d-45d9-422b-9a60-dcf168ab7752 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033976 Sep 23 15:20:40.440560 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 35/85] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:20:40.501691 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-825417cd-1e92-4d13-84a7-2fd0d34b05a6 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:40.509643 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-825417cd-1e92-4d13-84a7-2fd0d34b05a6 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1314 microversion: 2.1 time: 0.279288 Sep 23 15:20:40.510672 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 51/86] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:40 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:40.869061 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-7d2bea0c-dda8-4a08-939c-a366a01d14f2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:40.869798 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-7d2bea0c-dda8-4a08-939c-a366a01d14f2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:40.879060 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7d2bea0c-dda8-4a08-939c-a366a01d14f2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:40.879060 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7d2bea0c-dda8-4a08-939c-a366a01d14f2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:40.879060 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7d2bea0c-dda8-4a08-939c-a366a01d14f2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:40.879060 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7d2bea0c-dda8-4a08-939c-a366a01d14f2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:40.879447 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7d2bea0c-dda8-4a08-939c-a366a01d14f2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:40.879822 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7d2bea0c-dda8-4a08-939c-a366a01d14f2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:41.024961 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-7d2bea0c-dda8-4a08-939c-a366a01d14f2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:41.032926 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-7d2bea0c-dda8-4a08-939c-a366a01d14f2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1322 microversion: 2.1 time: 0.168119 Sep 23 15:20:41.033798 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 36/87] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:40 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:41.056841 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-9948b0cd-7c14-466b-8f9b-dc9665d71368 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:41.059339 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-9948b0cd-7c14-466b-8f9b-dc9665d71368 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:41.071541 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9948b0cd-7c14-466b-8f9b-dc9665d71368 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:41.082412 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9948b0cd-7c14-466b-8f9b-dc9665d71368 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:41.082412 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9948b0cd-7c14-466b-8f9b-dc9665d71368 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:41.082412 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9948b0cd-7c14-466b-8f9b-dc9665d71368 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:41.082412 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9948b0cd-7c14-466b-8f9b-dc9665d71368 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:41.082708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9948b0cd-7c14-466b-8f9b-dc9665d71368 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:41.221861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-9948b0cd-7c14-466b-8f9b-dc9665d71368 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:41.230281 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-9948b0cd-7c14-466b-8f9b-dc9665d71368 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1363 microversion: 2.1 time: 0.177280 Sep 23 15:20:41.231052 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 52/88] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:41 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:41.372694 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-db697e16-3dbe-4fc8-af4c-4d38221d6e20 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:41.373294 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-db697e16-3dbe-4fc8-af4c-4d38221d6e20 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:41.379462 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-db697e16-3dbe-4fc8-af4c-4d38221d6e20 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:41.380094 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-db697e16-3dbe-4fc8-af4c-4d38221d6e20 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:41.380664 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-db697e16-3dbe-4fc8-af4c-4d38221d6e20 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:41.381809 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-db697e16-3dbe-4fc8-af4c-4d38221d6e20 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:41.381904 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-db697e16-3dbe-4fc8-af4c-4d38221d6e20 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:41.382371 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-db697e16-3dbe-4fc8-af4c-4d38221d6e20 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:41.529779 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-db697e16-3dbe-4fc8-af4c-4d38221d6e20 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:41.534603 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-77f20ea3-c662-44bd-9f4e-b894b526f478 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:41.535779 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-77f20ea3-c662-44bd-9f4e-b894b526f478 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:41.537335 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell0:SELECT=22 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:41.538932 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-db697e16-3dbe-4fc8-af4c-4d38221d6e20 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:41.540200 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-db697e16-3dbe-4fc8-af4c-4d38221d6e20 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:41.541312 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-db697e16-3dbe-4fc8-af4c-4d38221d6e20 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1408 microversion: 2.20 time: 0.172839 Sep 23 15:20:41.542719 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 37/89] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:20:41 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:20:41.542827 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-77f20ea3-c662-44bd-9f4e-b894b526f478 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:41.544553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-77f20ea3-c662-44bd-9f4e-b894b526f478 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:41.545127 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-77f20ea3-c662-44bd-9f4e-b894b526f478 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:41.546052 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-77f20ea3-c662-44bd-9f4e-b894b526f478 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:41.546611 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-77f20ea3-c662-44bd-9f4e-b894b526f478 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:41.547443 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-77f20ea3-c662-44bd-9f4e-b894b526f478 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:41.688403 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-77f20ea3-c662-44bd-9f4e-b894b526f478 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:41.696587 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-77f20ea3-c662-44bd-9f4e-b894b526f478 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1314 microversion: 2.1 time: 0.166253 Sep 23 15:20:41.711882 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 53/90] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:41 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:42.057387 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6437fa2d-67f1-4700-b1bd-84c564f7c3a3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:42.059189 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-6437fa2d-67f1-4700-b1bd-84c564f7c3a3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:42.069736 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6437fa2d-67f1-4700-b1bd-84c564f7c3a3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:42.070488 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6437fa2d-67f1-4700-b1bd-84c564f7c3a3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:42.071103 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6437fa2d-67f1-4700-b1bd-84c564f7c3a3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:42.071830 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6437fa2d-67f1-4700-b1bd-84c564f7c3a3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:42.072573 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6437fa2d-67f1-4700-b1bd-84c564f7c3a3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:42.073015 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6437fa2d-67f1-4700-b1bd-84c564f7c3a3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:42.255770 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-62ab08e9-7dab-42f6-8bdd-2151a0f5bae7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:42.257892 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-62ab08e9-7dab-42f6-8bdd-2151a0f5bae7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:42.266170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-62ab08e9-7dab-42f6-8bdd-2151a0f5bae7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:42.267491 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-62ab08e9-7dab-42f6-8bdd-2151a0f5bae7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:42.267964 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-62ab08e9-7dab-42f6-8bdd-2151a0f5bae7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:42.269667 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-62ab08e9-7dab-42f6-8bdd-2151a0f5bae7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:42.270288 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-62ab08e9-7dab-42f6-8bdd-2151a0f5bae7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:42.270783 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-62ab08e9-7dab-42f6-8bdd-2151a0f5bae7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:42.306218 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6437fa2d-67f1-4700-b1bd-84c564f7c3a3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:42.319458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-6437fa2d-67f1-4700-b1bd-84c564f7c3a3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1322 microversion: 2.1 time: 0.266428 Sep 23 15:20:42.320821 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 38/91] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:42 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:42.489951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-62ab08e9-7dab-42f6-8bdd-2151a0f5bae7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:42.501712 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-62ab08e9-7dab-42f6-8bdd-2151a0f5bae7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1363 microversion: 2.1 time: 0.252038 Sep 23 15:20:42.502485 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 54/92] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:42 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:42.566716 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-31305918-f015-40eb-bb6b-d2c27266edd9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:42.567528 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-31305918-f015-40eb-bb6b-d2c27266edd9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:42.576619 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-31305918-f015-40eb-bb6b-d2c27266edd9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:42.577419 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-31305918-f015-40eb-bb6b-d2c27266edd9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:42.577964 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-31305918-f015-40eb-bb6b-d2c27266edd9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:42.578756 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-31305918-f015-40eb-bb6b-d2c27266edd9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:42.579533 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-31305918-f015-40eb-bb6b-d2c27266edd9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:42.580076 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-31305918-f015-40eb-bb6b-d2c27266edd9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:42.721714 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b2618f87-1aed-443e-9385-39d80ae7b998 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:42.722798 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-b2618f87-1aed-443e-9385-39d80ae7b998 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:42.729873 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b2618f87-1aed-443e-9385-39d80ae7b998 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:42.732672 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b2618f87-1aed-443e-9385-39d80ae7b998 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:42.734083 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b2618f87-1aed-443e-9385-39d80ae7b998 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:42.734831 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b2618f87-1aed-443e-9385-39d80ae7b998 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:42.735294 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b2618f87-1aed-443e-9385-39d80ae7b998 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:42.736560 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b2618f87-1aed-443e-9385-39d80ae7b998 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:42.762130 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-31305918-f015-40eb-bb6b-d2c27266edd9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:42.771927 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-31305918-f015-40eb-bb6b-d2c27266edd9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:42.776068 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-31305918-f015-40eb-bb6b-d2c27266edd9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:42.776068 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-31305918-f015-40eb-bb6b-d2c27266edd9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1408 microversion: 2.20 time: 0.211733 Sep 23 15:20:42.776068 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 39/93] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:20:42 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:20:42.879909 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-b2618f87-1aed-443e-9385-39d80ae7b998 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:42.892828 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-b2618f87-1aed-443e-9385-39d80ae7b998 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1314 microversion: 2.1 time: 0.175274 Sep 23 15:20:42.892828 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 55/94] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:42 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:43.349711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-7d4bf986-f2d0-481f-b327-6d0579220044 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:43.350331 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-7d4bf986-f2d0-481f-b327-6d0579220044 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:43.357170 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7d4bf986-f2d0-481f-b327-6d0579220044 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:43.357653 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7d4bf986-f2d0-481f-b327-6d0579220044 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:43.358090 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7d4bf986-f2d0-481f-b327-6d0579220044 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:43.358779 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7d4bf986-f2d0-481f-b327-6d0579220044 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:43.359236 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7d4bf986-f2d0-481f-b327-6d0579220044 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:43.359661 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7d4bf986-f2d0-481f-b327-6d0579220044 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:43.490906 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-7d4bf986-f2d0-481f-b327-6d0579220044 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:43.498755 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-7d4bf986-f2d0-481f-b327-6d0579220044 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1322 microversion: 2.1 time: 0.153288 Sep 23 15:20:43.499520 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 40/95] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:43 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:43.528181 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-325893a0-4683-441f-9a15-5868a15991a6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:43.529111 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-325893a0-4683-441f-9a15-5868a15991a6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:43.535542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-325893a0-4683-441f-9a15-5868a15991a6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:43.536056 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-325893a0-4683-441f-9a15-5868a15991a6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:43.536563 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-325893a0-4683-441f-9a15-5868a15991a6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:43.537427 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-325893a0-4683-441f-9a15-5868a15991a6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:43.537882 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-325893a0-4683-441f-9a15-5868a15991a6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:43.538305 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-325893a0-4683-441f-9a15-5868a15991a6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:43.675721 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-325893a0-4683-441f-9a15-5868a15991a6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:43.683745 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-325893a0-4683-441f-9a15-5868a15991a6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1363 microversion: 2.1 time: 0.160589 Sep 23 15:20:43.694547 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 56/96] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:43 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:43.801105 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-f5469220-2e4b-47cc-b9ec-b67aa5e18da2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:43.801711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-f5469220-2e4b-47cc-b9ec-b67aa5e18da2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:43.807674 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f5469220-2e4b-47cc-b9ec-b67aa5e18da2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:43.808177 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f5469220-2e4b-47cc-b9ec-b67aa5e18da2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:43.808613 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f5469220-2e4b-47cc-b9ec-b67aa5e18da2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:43.809301 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f5469220-2e4b-47cc-b9ec-b67aa5e18da2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:43.809749 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f5469220-2e4b-47cc-b9ec-b67aa5e18da2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:43.810170 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f5469220-2e4b-47cc-b9ec-b67aa5e18da2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:43.915221 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-cd0602b7-168b-43f4-a8ee-49dc3d6a916a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:43.916503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-cd0602b7-168b-43f4-a8ee-49dc3d6a916a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:43.922431 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cd0602b7-168b-43f4-a8ee-49dc3d6a916a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:43.922904 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cd0602b7-168b-43f4-a8ee-49dc3d6a916a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:43.923329 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cd0602b7-168b-43f4-a8ee-49dc3d6a916a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:43.924034 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cd0602b7-168b-43f4-a8ee-49dc3d6a916a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:43.924485 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cd0602b7-168b-43f4-a8ee-49dc3d6a916a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:43.924901 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cd0602b7-168b-43f4-a8ee-49dc3d6a916a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:43.984799 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-f5469220-2e4b-47cc-b9ec-b67aa5e18da2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:43.996136 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-f5469220-2e4b-47cc-b9ec-b67aa5e18da2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:44.001525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-f5469220-2e4b-47cc-b9ec-b67aa5e18da2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:44.001525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-f5469220-2e4b-47cc-b9ec-b67aa5e18da2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1408 microversion: 2.20 time: 0.201655 Sep 23 15:20:44.001525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 41/97] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:20:43 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1408 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:20:44.140901 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-cd0602b7-168b-43f4-a8ee-49dc3d6a916a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:44.148469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-cd0602b7-168b-43f4-a8ee-49dc3d6a916a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1314 microversion: 2.1 time: 0.237272 Sep 23 15:20:44.149115 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 57/98] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:43 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:44.521677 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-5255c899-e108-4062-abb4-959f278938ee tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:44.522225 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-5255c899-e108-4062-abb4-959f278938ee tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:44.528681 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5255c899-e108-4062-abb4-959f278938ee tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:44.529162 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5255c899-e108-4062-abb4-959f278938ee tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:44.529596 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5255c899-e108-4062-abb4-959f278938ee tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:44.530307 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5255c899-e108-4062-abb4-959f278938ee tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:44.530766 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5255c899-e108-4062-abb4-959f278938ee tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:44.531189 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5255c899-e108-4062-abb4-959f278938ee tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:44.670987 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-5255c899-e108-4062-abb4-959f278938ee tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:44.676882 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-5255c899-e108-4062-abb4-959f278938ee tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1322 microversion: 2.1 time: 0.159110 Sep 23 15:20:44.677454 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 42/99] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:44 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:44.716143 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-df59d27e-abc8-4dac-9639-6c38f080296f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:44.716836 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-df59d27e-abc8-4dac-9639-6c38f080296f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:44.723061 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-df59d27e-abc8-4dac-9639-6c38f080296f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:44.723624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-df59d27e-abc8-4dac-9639-6c38f080296f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:44.724171 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-df59d27e-abc8-4dac-9639-6c38f080296f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:44.724937 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-df59d27e-abc8-4dac-9639-6c38f080296f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:44.725462 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-df59d27e-abc8-4dac-9639-6c38f080296f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:44.725974 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-df59d27e-abc8-4dac-9639-6c38f080296f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:44.866433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-df59d27e-abc8-4dac-9639-6c38f080296f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:44.874688 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-df59d27e-abc8-4dac-9639-6c38f080296f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1363 microversion: 2.1 time: 0.163785 Sep 23 15:20:44.875317 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 58/100] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:44 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:45.024230 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-3ad81206-137b-43ad-bf7c-156a1ff420eb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:45.024852 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-3ad81206-137b-43ad-bf7c-156a1ff420eb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:45.032626 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3ad81206-137b-43ad-bf7c-156a1ff420eb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:45.033051 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3ad81206-137b-43ad-bf7c-156a1ff420eb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:45.033514 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3ad81206-137b-43ad-bf7c-156a1ff420eb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:45.034215 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3ad81206-137b-43ad-bf7c-156a1ff420eb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:45.036293 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3ad81206-137b-43ad-bf7c-156a1ff420eb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:45.036293 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3ad81206-137b-43ad-bf7c-156a1ff420eb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:45.176075 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-d043111e-fb91-419c-b5fa-f55e6e5a286d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:45.177293 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-d043111e-fb91-419c-b5fa-f55e6e5a286d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:45.185581 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d043111e-fb91-419c-b5fa-f55e6e5a286d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:45.186465 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d043111e-fb91-419c-b5fa-f55e6e5a286d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:45.187040 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d043111e-fb91-419c-b5fa-f55e6e5a286d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:45.188068 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d043111e-fb91-419c-b5fa-f55e6e5a286d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:45.188533 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-3ad81206-137b-43ad-bf7c-156a1ff420eb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:45.188948 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d043111e-fb91-419c-b5fa-f55e6e5a286d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:45.189786 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d043111e-fb91-419c-b5fa-f55e6e5a286d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:45.201180 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-3ad81206-137b-43ad-bf7c-156a1ff420eb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:45.202774 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-3ad81206-137b-43ad-bf7c-156a1ff420eb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:45.204061 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-3ad81206-137b-43ad-bf7c-156a1ff420eb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1408 microversion: 2.20 time: 0.183858 Sep 23 15:20:45.218389 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 43/101] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:20:45 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:20:45.551653 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-d043111e-fb91-419c-b5fa-f55e6e5a286d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:45.560354 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-d043111e-fb91-419c-b5fa-f55e6e5a286d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1314 microversion: 2.1 time: 0.389059 Sep 23 15:20:45.560935 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 59/102] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:45 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:45.701803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-0a3b3ecc-d2fc-4aad-998d-27a51958454c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:45.702425 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-0a3b3ecc-d2fc-4aad-998d-27a51958454c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:45.708429 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0a3b3ecc-d2fc-4aad-998d-27a51958454c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:45.708924 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0a3b3ecc-d2fc-4aad-998d-27a51958454c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:45.709343 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0a3b3ecc-d2fc-4aad-998d-27a51958454c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:45.710024 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0a3b3ecc-d2fc-4aad-998d-27a51958454c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:45.710478 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0a3b3ecc-d2fc-4aad-998d-27a51958454c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:45.710899 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0a3b3ecc-d2fc-4aad-998d-27a51958454c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:45.890321 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-0a3b3ecc-d2fc-4aad-998d-27a51958454c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:45.898284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-8dad6c53-efdd-4141-a0ef-b155bd55a867 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:45.903284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-8dad6c53-efdd-4141-a0ef-b155bd55a867 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:45.903683 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-0a3b3ecc-d2fc-4aad-998d-27a51958454c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1322 microversion: 2.1 time: 0.202686 Sep 23 15:20:45.903683 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 44/103] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:45 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:45.917964 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8dad6c53-efdd-4141-a0ef-b155bd55a867 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:45.918602 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8dad6c53-efdd-4141-a0ef-b155bd55a867 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:45.919050 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8dad6c53-efdd-4141-a0ef-b155bd55a867 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:45.919811 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8dad6c53-efdd-4141-a0ef-b155bd55a867 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:45.920322 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8dad6c53-efdd-4141-a0ef-b155bd55a867 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:45.920971 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8dad6c53-efdd-4141-a0ef-b155bd55a867 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:46.123889 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-8dad6c53-efdd-4141-a0ef-b155bd55a867 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:46.138187 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-8dad6c53-efdd-4141-a0ef-b155bd55a867 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1363 microversion: 2.1 time: 0.243658 Sep 23 15:20:46.139028 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 60/104] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:45 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:46.243691 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-87452530-e699-4f20-bb58-1028cb38f339 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:46.244345 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-87452530-e699-4f20-bb58-1028cb38f339 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:46.251014 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-87452530-e699-4f20-bb58-1028cb38f339 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:46.251489 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-87452530-e699-4f20-bb58-1028cb38f339 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:46.251916 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-87452530-e699-4f20-bb58-1028cb38f339 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:46.252618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-87452530-e699-4f20-bb58-1028cb38f339 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:46.253114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-87452530-e699-4f20-bb58-1028cb38f339 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:46.253529 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-87452530-e699-4f20-bb58-1028cb38f339 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:46.288830 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-64b87796-0b45-4ce4-b3a1-b4b9d1793571 req-875525a9-1761-4408-a8e8-6e10574e0f32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bba6fdd-bec4-491e-81ba-f3a9863f72ca", "tag": "8801bad0-f531-42e9-8015-b0d63a8e4f8e"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:20:46.299782 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-64b87796-0b45-4ce4-b3a1-b4b9d1793571 req-875525a9-1761-4408-a8e8-6e10574e0f32 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:46.300298 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-64b87796-0b45-4ce4-b3a1-b4b9d1793571 req-875525a9-1761-4408-a8e8-6e10574e0f32 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:46.300735 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-64b87796-0b45-4ce4-b3a1-b4b9d1793571 req-875525a9-1761-4408-a8e8-6e10574e0f32 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:46.319055 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-64b87796-0b45-4ce4-b3a1-b4b9d1793571 req-875525a9-1761-4408-a8e8-6e10574e0f32 service nova] Creating event network-changed:8801bad0-f531-42e9-8015-b0d63a8e4f8e for instance 4bba6fdd-bec4-491e-81ba-f3a9863f72ca on hv-cinder-85530 Sep 23 15:20:46.331933 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-64b87796-0b45-4ce4-b3a1-b4b9d1793571 req-875525a9-1761-4408-a8e8-6e10574e0f32 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047157 Sep 23 15:20:46.335409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 61/105] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:20:46.403340 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-87452530-e699-4f20-bb58-1028cb38f339 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:46.412865 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-87452530-e699-4f20-bb58-1028cb38f339 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:46.414337 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-87452530-e699-4f20-bb58-1028cb38f339 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:46.415476 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-87452530-e699-4f20-bb58-1028cb38f339 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1408 microversion: 2.20 time: 0.175780 Sep 23 15:20:46.416040 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 45/106] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:20:46 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:20:46.584581 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-7ffa7b2d-501a-4673-a7ae-163d8e30d91f tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:46.585269 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-7ffa7b2d-501a-4673-a7ae-163d8e30d91f tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:46.592058 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7ffa7b2d-501a-4673-a7ae-163d8e30d91f tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:46.592534 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7ffa7b2d-501a-4673-a7ae-163d8e30d91f tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:46.592962 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7ffa7b2d-501a-4673-a7ae-163d8e30d91f tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:46.593640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7ffa7b2d-501a-4673-a7ae-163d8e30d91f tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:46.594079 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7ffa7b2d-501a-4673-a7ae-163d8e30d91f tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:46.594543 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7ffa7b2d-501a-4673-a7ae-163d8e30d91f tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:46.728078 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-7ffa7b2d-501a-4673-a7ae-163d8e30d91f tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:46.736485 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-7ffa7b2d-501a-4673-a7ae-163d8e30d91f tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1314 microversion: 2.1 time: 0.156014 Sep 23 15:20:46.737057 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 62/107] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:46 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:46.923884 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-75133fd6-e3f2-4594-a139-277cf00edf5a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:46.924785 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-75133fd6-e3f2-4594-a139-277cf00edf5a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:46.931524 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-75133fd6-e3f2-4594-a139-277cf00edf5a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:46.932480 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-75133fd6-e3f2-4594-a139-277cf00edf5a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:46.933137 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-75133fd6-e3f2-4594-a139-277cf00edf5a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:46.934149 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-75133fd6-e3f2-4594-a139-277cf00edf5a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:46.934918 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-75133fd6-e3f2-4594-a139-277cf00edf5a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:46.935452 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-75133fd6-e3f2-4594-a139-277cf00edf5a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:47.069400 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-75133fd6-e3f2-4594-a139-277cf00edf5a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:47.078495 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-75133fd6-e3f2-4594-a139-277cf00edf5a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1322 microversion: 2.1 time: 0.159387 Sep 23 15:20:47.079098 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 46/108] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:46 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:47.167584 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a1789a17-c80b-4bed-b940-ad5a63d6e1c5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:47.168228 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-a1789a17-c80b-4bed-b940-ad5a63d6e1c5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:47.170131 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell0:SELECT=2 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:47.174870 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a1789a17-c80b-4bed-b940-ad5a63d6e1c5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:47.175344 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a1789a17-c80b-4bed-b940-ad5a63d6e1c5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:47.175775 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a1789a17-c80b-4bed-b940-ad5a63d6e1c5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:47.176517 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a1789a17-c80b-4bed-b940-ad5a63d6e1c5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:47.176986 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a1789a17-c80b-4bed-b940-ad5a63d6e1c5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:47.177406 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a1789a17-c80b-4bed-b940-ad5a63d6e1c5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:47.200080 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=100 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:47.330640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a1789a17-c80b-4bed-b940-ad5a63d6e1c5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:47.340533 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-a1789a17-c80b-4bed-b940-ad5a63d6e1c5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1363 microversion: 2.1 time: 0.176741 Sep 23 15:20:47.341246 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 63/109] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:47 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:47.441629 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-fdac2adb-49ec-4245-905f-7cfa96d47c8d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:47.442234 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-fdac2adb-49ec-4245-905f-7cfa96d47c8d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:47.449110 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fdac2adb-49ec-4245-905f-7cfa96d47c8d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:47.449589 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fdac2adb-49ec-4245-905f-7cfa96d47c8d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:47.450108 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fdac2adb-49ec-4245-905f-7cfa96d47c8d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:47.450801 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fdac2adb-49ec-4245-905f-7cfa96d47c8d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:47.451253 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fdac2adb-49ec-4245-905f-7cfa96d47c8d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:47.451675 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fdac2adb-49ec-4245-905f-7cfa96d47c8d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:47.589995 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-fdac2adb-49ec-4245-905f-7cfa96d47c8d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:47.597962 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-fdac2adb-49ec-4245-905f-7cfa96d47c8d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:47.599409 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-fdac2adb-49ec-4245-905f-7cfa96d47c8d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:47.600574 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-fdac2adb-49ec-4245-905f-7cfa96d47c8d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1408 microversion: 2.20 time: 0.163016 Sep 23 15:20:47.601127 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 47/110] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:20:47 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:20:47.770662 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-460d70ac-8aab-4200-8b5d-c8eab1442c00 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:47.770851 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-460d70ac-8aab-4200-8b5d-c8eab1442c00 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:47.778923 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-460d70ac-8aab-4200-8b5d-c8eab1442c00 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:47.779442 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-460d70ac-8aab-4200-8b5d-c8eab1442c00 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:47.779884 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-460d70ac-8aab-4200-8b5d-c8eab1442c00 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:47.780710 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-460d70ac-8aab-4200-8b5d-c8eab1442c00 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:47.781171 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-460d70ac-8aab-4200-8b5d-c8eab1442c00 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:47.781597 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-460d70ac-8aab-4200-8b5d-c8eab1442c00 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:47.914212 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-460d70ac-8aab-4200-8b5d-c8eab1442c00 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:47.922506 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-460d70ac-8aab-4200-8b5d-c8eab1442c00 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1314 microversion: 2.1 time: 0.159154 Sep 23 15:20:47.923155 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 64/111] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:47 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:48.105435 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-dc22cdc9-b55f-4bb3-bdf7-892ff1248f02 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:48.106084 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-dc22cdc9-b55f-4bb3-bdf7-892ff1248f02 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:48.108426 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell0:SELECT=10 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:48.113521 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dc22cdc9-b55f-4bb3-bdf7-892ff1248f02 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:48.114011 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dc22cdc9-b55f-4bb3-bdf7-892ff1248f02 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:48.114480 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dc22cdc9-b55f-4bb3-bdf7-892ff1248f02 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:48.115363 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dc22cdc9-b55f-4bb3-bdf7-892ff1248f02 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:48.115823 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dc22cdc9-b55f-4bb3-bdf7-892ff1248f02 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:48.116312 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dc22cdc9-b55f-4bb3-bdf7-892ff1248f02 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:48.247819 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-dc22cdc9-b55f-4bb3-bdf7-892ff1248f02 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:48.255486 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-dc22cdc9-b55f-4bb3-bdf7-892ff1248f02 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1322 microversion: 2.1 time: 0.155066 Sep 23 15:20:48.256069 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 48/112] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:48 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:48.364268 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a5ea8c93-0fc5-43c6-aef4-93a20a3ef964 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:48.364907 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-a5ea8c93-0fc5-43c6-aef4-93a20a3ef964 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:48.371655 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a5ea8c93-0fc5-43c6-aef4-93a20a3ef964 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:48.372171 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a5ea8c93-0fc5-43c6-aef4-93a20a3ef964 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:48.372635 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a5ea8c93-0fc5-43c6-aef4-93a20a3ef964 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:48.373530 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a5ea8c93-0fc5-43c6-aef4-93a20a3ef964 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:48.373979 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a5ea8c93-0fc5-43c6-aef4-93a20a3ef964 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:48.374439 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a5ea8c93-0fc5-43c6-aef4-93a20a3ef964 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:48.510883 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a5ea8c93-0fc5-43c6-aef4-93a20a3ef964 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:48.518808 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-a5ea8c93-0fc5-43c6-aef4-93a20a3ef964 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1363 microversion: 2.1 time: 0.158713 Sep 23 15:20:48.519385 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 65/113] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:48 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:48.626998 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-77d6815b-77ff-4b5a-8198-1f6d6228721c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:48.627650 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-77d6815b-77ff-4b5a-8198-1f6d6228721c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:48.633875 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-77d6815b-77ff-4b5a-8198-1f6d6228721c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:48.634357 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-77d6815b-77ff-4b5a-8198-1f6d6228721c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:48.634792 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-77d6815b-77ff-4b5a-8198-1f6d6228721c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:48.635738 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-77d6815b-77ff-4b5a-8198-1f6d6228721c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:48.636378 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-77d6815b-77ff-4b5a-8198-1f6d6228721c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:48.636811 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-77d6815b-77ff-4b5a-8198-1f6d6228721c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:48.782482 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-77d6815b-77ff-4b5a-8198-1f6d6228721c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:48.790554 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-77d6815b-77ff-4b5a-8198-1f6d6228721c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:48.793288 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-77d6815b-77ff-4b5a-8198-1f6d6228721c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:48.794408 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-77d6815b-77ff-4b5a-8198-1f6d6228721c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1408 microversion: 2.20 time: 0.171291 Sep 23 15:20:48.795089 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 49/114] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:20:48 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:20:48.953102 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-08d17d42-fd06-43b1-b309-4d30c3399386 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:48.954208 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-08d17d42-fd06-43b1-b309-4d30c3399386 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:48.962319 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-08d17d42-fd06-43b1-b309-4d30c3399386 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:48.962996 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-08d17d42-fd06-43b1-b309-4d30c3399386 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:48.964257 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-08d17d42-fd06-43b1-b309-4d30c3399386 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:48.965569 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-08d17d42-fd06-43b1-b309-4d30c3399386 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:48.966261 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-08d17d42-fd06-43b1-b309-4d30c3399386 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:48.966939 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-08d17d42-fd06-43b1-b309-4d30c3399386 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:49.127374 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-08d17d42-fd06-43b1-b309-4d30c3399386 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:49.137142 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-08d17d42-fd06-43b1-b309-4d30c3399386 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1314 microversion: 2.1 time: 0.191785 Sep 23 15:20:49.137142 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 66/115] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:48 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:49.280591 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a93dca0a-7ba5-42dc-a83d-3e3be58552f7 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:49.281518 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-a93dca0a-7ba5-42dc-a83d-3e3be58552f7 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:49.287951 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a93dca0a-7ba5-42dc-a83d-3e3be58552f7 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:49.288456 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a93dca0a-7ba5-42dc-a83d-3e3be58552f7 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:49.288907 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a93dca0a-7ba5-42dc-a83d-3e3be58552f7 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:49.289818 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a93dca0a-7ba5-42dc-a83d-3e3be58552f7 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:49.290281 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a93dca0a-7ba5-42dc-a83d-3e3be58552f7 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:49.290703 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a93dca0a-7ba5-42dc-a83d-3e3be58552f7 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:49.435650 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a93dca0a-7ba5-42dc-a83d-3e3be58552f7 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:49.443401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-a93dca0a-7ba5-42dc-a83d-3e3be58552f7 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1322 microversion: 2.1 time: 0.167656 Sep 23 15:20:49.444478 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 50/116] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:49 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:49.542683 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-6ce2633c-c701-49ee-9f49-5f27a34b2d14 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:49.543284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-6ce2633c-c701-49ee-9f49-5f27a34b2d14 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:49.549330 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6ce2633c-c701-49ee-9f49-5f27a34b2d14 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:49.549802 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6ce2633c-c701-49ee-9f49-5f27a34b2d14 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:49.550227 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6ce2633c-c701-49ee-9f49-5f27a34b2d14 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:49.550904 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6ce2633c-c701-49ee-9f49-5f27a34b2d14 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:49.551346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6ce2633c-c701-49ee-9f49-5f27a34b2d14 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:49.551761 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6ce2633c-c701-49ee-9f49-5f27a34b2d14 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:49.684515 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-6ce2633c-c701-49ee-9f49-5f27a34b2d14 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:49.692222 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-6ce2633c-c701-49ee-9f49-5f27a34b2d14 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1363 microversion: 2.1 time: 0.154046 Sep 23 15:20:49.692884 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 67/117] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:49 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:49.818901 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-b0b3b4d2-6e89-4e44-bda5-af002de1e770 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:49.819505 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-b0b3b4d2-6e89-4e44-bda5-af002de1e770 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:49.826128 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b0b3b4d2-6e89-4e44-bda5-af002de1e770 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:49.826526 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b0b3b4d2-6e89-4e44-bda5-af002de1e770 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:49.827266 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b0b3b4d2-6e89-4e44-bda5-af002de1e770 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:49.828097 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b0b3b4d2-6e89-4e44-bda5-af002de1e770 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:49.828410 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b0b3b4d2-6e89-4e44-bda5-af002de1e770 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:49.828822 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b0b3b4d2-6e89-4e44-bda5-af002de1e770 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:49.968725 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b0b3b4d2-6e89-4e44-bda5-af002de1e770 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:49.972465 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=100 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:49.977886 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b0b3b4d2-6e89-4e44-bda5-af002de1e770 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:49.979743 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b0b3b4d2-6e89-4e44-bda5-af002de1e770 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:49.980953 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-b0b3b4d2-6e89-4e44-bda5-af002de1e770 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1408 microversion: 2.20 time: 0.165893 Sep 23 15:20:49.984116 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 51/118] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:20:49 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:20:50.159877 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-7ee8b174-361c-44c2-8d0a-28f77f1baaa3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:50.160507 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-7ee8b174-361c-44c2-8d0a-28f77f1baaa3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:50.166686 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7ee8b174-361c-44c2-8d0a-28f77f1baaa3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:50.167144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7ee8b174-361c-44c2-8d0a-28f77f1baaa3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:50.167575 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7ee8b174-361c-44c2-8d0a-28f77f1baaa3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:50.168300 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7ee8b174-361c-44c2-8d0a-28f77f1baaa3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:50.168751 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7ee8b174-361c-44c2-8d0a-28f77f1baaa3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:50.169169 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7ee8b174-361c-44c2-8d0a-28f77f1baaa3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:50.301685 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-7ee8b174-361c-44c2-8d0a-28f77f1baaa3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:50.318677 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-7ee8b174-361c-44c2-8d0a-28f77f1baaa3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1314 microversion: 2.1 time: 0.162503 Sep 23 15:20:50.333767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 68/119] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:50 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:50.466306 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a4e9405b-4629-4520-b08d-fee219f8326e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:50.466910 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-a4e9405b-4629-4520-b08d-fee219f8326e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:50.473853 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a4e9405b-4629-4520-b08d-fee219f8326e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:50.474330 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a4e9405b-4629-4520-b08d-fee219f8326e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:50.474754 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a4e9405b-4629-4520-b08d-fee219f8326e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:50.475616 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a4e9405b-4629-4520-b08d-fee219f8326e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:50.476199 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a4e9405b-4629-4520-b08d-fee219f8326e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:50.476779 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a4e9405b-4629-4520-b08d-fee219f8326e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:50.722550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-c73d07f3-9241-4dc3-842e-7bfaffeb3b42 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:50.722550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-c73d07f3-9241-4dc3-842e-7bfaffeb3b42 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:50.728764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c73d07f3-9241-4dc3-842e-7bfaffeb3b42 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:50.731285 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c73d07f3-9241-4dc3-842e-7bfaffeb3b42 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:50.732190 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c73d07f3-9241-4dc3-842e-7bfaffeb3b42 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:50.733174 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c73d07f3-9241-4dc3-842e-7bfaffeb3b42 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:50.733793 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c73d07f3-9241-4dc3-842e-7bfaffeb3b42 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:50.734579 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c73d07f3-9241-4dc3-842e-7bfaffeb3b42 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:50.743136 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a4e9405b-4629-4520-b08d-fee219f8326e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:50.755606 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-a4e9405b-4629-4520-b08d-fee219f8326e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1322 microversion: 2.1 time: 0.293199 Sep 23 15:20:50.760991 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 52/120] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:50 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:51.008653 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-5af0c419-eeca-45c7-9aa1-dbfc3033ca77 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:51.009321 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-5af0c419-eeca-45c7-9aa1-dbfc3033ca77 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:51.016281 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5af0c419-eeca-45c7-9aa1-dbfc3033ca77 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:51.016975 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5af0c419-eeca-45c7-9aa1-dbfc3033ca77 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:51.017626 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5af0c419-eeca-45c7-9aa1-dbfc3033ca77 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:51.018676 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5af0c419-eeca-45c7-9aa1-dbfc3033ca77 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:51.019185 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5af0c419-eeca-45c7-9aa1-dbfc3033ca77 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:51.019571 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5af0c419-eeca-45c7-9aa1-dbfc3033ca77 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:51.169532 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-5af0c419-eeca-45c7-9aa1-dbfc3033ca77 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:51.177874 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-5af0c419-eeca-45c7-9aa1-dbfc3033ca77 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:51.179564 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-5af0c419-eeca-45c7-9aa1-dbfc3033ca77 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:51.180698 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-5af0c419-eeca-45c7-9aa1-dbfc3033ca77 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1408 microversion: 2.20 time: 0.176093 Sep 23 15:20:51.181249 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 53/121] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:20:51 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:20:51.303496 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-c73d07f3-9241-4dc3-842e-7bfaffeb3b42 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:51.311772 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-c73d07f3-9241-4dc3-842e-7bfaffeb3b42 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1363 microversion: 2.1 time: 0.599568 Sep 23 15:20:51.312383 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 69/122] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:50 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1363 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:51.344258 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-c0d08055-405a-431b-a673-e598bdff502f tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:51.345131 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-c0d08055-405a-431b-a673-e598bdff502f tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:51.360117 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c0d08055-405a-431b-a673-e598bdff502f tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:51.360915 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c0d08055-405a-431b-a673-e598bdff502f tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:51.361576 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c0d08055-405a-431b-a673-e598bdff502f tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:51.362620 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c0d08055-405a-431b-a673-e598bdff502f tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:51.363026 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c0d08055-405a-431b-a673-e598bdff502f tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:51.363847 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c0d08055-405a-431b-a673-e598bdff502f tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:51.519186 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-c0d08055-405a-431b-a673-e598bdff502f tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:51.528095 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-c0d08055-405a-431b-a673-e598bdff502f tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1314 microversion: 2.1 time: 0.187637 Sep 23 15:20:51.534142 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 54/123] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:51 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:51.779771 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-cf6413db-7a78-4c06-93e0-802330eb937b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:51.781344 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-cf6413db-7a78-4c06-93e0-802330eb937b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:51.788313 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cf6413db-7a78-4c06-93e0-802330eb937b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:51.788808 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cf6413db-7a78-4c06-93e0-802330eb937b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:51.789227 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cf6413db-7a78-4c06-93e0-802330eb937b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:51.789942 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cf6413db-7a78-4c06-93e0-802330eb937b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:51.790418 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cf6413db-7a78-4c06-93e0-802330eb937b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:51.790827 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cf6413db-7a78-4c06-93e0-802330eb937b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:52.181463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-cf6413db-7a78-4c06-93e0-802330eb937b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:52.193659 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-cf6413db-7a78-4c06-93e0-802330eb937b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1322 microversion: 2.1 time: 0.418675 Sep 23 15:20:52.194397 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 70/124] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:51 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1322 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:52.207491 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-b1202d4b-ee88-4482-aec0-b28e54fb2aeb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:52.208040 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-b1202d4b-ee88-4482-aec0-b28e54fb2aeb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:52.218584 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b1202d4b-ee88-4482-aec0-b28e54fb2aeb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:52.219104 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b1202d4b-ee88-4482-aec0-b28e54fb2aeb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:52.219535 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b1202d4b-ee88-4482-aec0-b28e54fb2aeb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:52.220252 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b1202d4b-ee88-4482-aec0-b28e54fb2aeb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:52.220701 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b1202d4b-ee88-4482-aec0-b28e54fb2aeb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:52.221117 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b1202d4b-ee88-4482-aec0-b28e54fb2aeb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:52.343687 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-490fab2b-c081-4601-964c-c5d2d96f2d0a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:52.343687 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-490fab2b-c081-4601-964c-c5d2d96f2d0a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:52.346367 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-490fab2b-c081-4601-964c-c5d2d96f2d0a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:52.346922 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-490fab2b-c081-4601-964c-c5d2d96f2d0a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:52.347582 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-490fab2b-c081-4601-964c-c5d2d96f2d0a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:52.348374 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-490fab2b-c081-4601-964c-c5d2d96f2d0a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:52.348883 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-490fab2b-c081-4601-964c-c5d2d96f2d0a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:52.349330 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-490fab2b-c081-4601-964c-c5d2d96f2d0a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:52.367734 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b1202d4b-ee88-4482-aec0-b28e54fb2aeb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:52.378292 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b1202d4b-ee88-4482-aec0-b28e54fb2aeb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:52.379843 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b1202d4b-ee88-4482-aec0-b28e54fb2aeb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:52.381103 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-b1202d4b-ee88-4482-aec0-b28e54fb2aeb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1408 microversion: 2.20 time: 0.178078 Sep 23 15:20:52.382261 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 55/125] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:20:52 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:20:52.558852 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-261276da-f4cf-4571-8b38-ab40929f973c tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:52.560884 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-261276da-f4cf-4571-8b38-ab40929f973c tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:52.570044 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-261276da-f4cf-4571-8b38-ab40929f973c tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:52.570862 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-261276da-f4cf-4571-8b38-ab40929f973c tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:52.571580 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-261276da-f4cf-4571-8b38-ab40929f973c tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:52.577202 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-261276da-f4cf-4571-8b38-ab40929f973c tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:52.578522 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-261276da-f4cf-4571-8b38-ab40929f973c tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:52.579305 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-261276da-f4cf-4571-8b38-ab40929f973c tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:52.690598 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-490fab2b-c081-4601-964c-c5d2d96f2d0a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:52.700011 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-490fab2b-c081-4601-964c-c5d2d96f2d0a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1363 microversion: 2.1 time: 0.365987 Sep 23 15:20:52.715969 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 71/126] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:52 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1363 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:52.747362 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-261276da-f4cf-4571-8b38-ab40929f973c tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:52.755560 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-261276da-f4cf-4571-8b38-ab40929f973c tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1314 microversion: 2.1 time: 0.205603 Sep 23 15:20:52.756189 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 56/127] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:52 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:53.222473 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-57f80589-c059-4bc5-b675-209bc2512e6b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:53.223077 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-57f80589-c059-4bc5-b675-209bc2512e6b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:53.229811 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-57f80589-c059-4bc5-b675-209bc2512e6b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:53.230463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-57f80589-c059-4bc5-b675-209bc2512e6b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:53.230957 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-57f80589-c059-4bc5-b675-209bc2512e6b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:53.231658 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-57f80589-c059-4bc5-b675-209bc2512e6b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:53.232167 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-57f80589-c059-4bc5-b675-209bc2512e6b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:53.232830 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-57f80589-c059-4bc5-b675-209bc2512e6b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:53.370572 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-57f80589-c059-4bc5-b675-209bc2512e6b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:53.381451 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-57f80589-c059-4bc5-b675-209bc2512e6b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1322 microversion: 2.1 time: 0.162047 Sep 23 15:20:53.383083 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 72/128] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:53 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:53.407946 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-e0bd7bcf-b883-4ea2-b5fa-0b999eebac1e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:53.408569 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-e0bd7bcf-b883-4ea2-b5fa-0b999eebac1e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:53.414791 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e0bd7bcf-b883-4ea2-b5fa-0b999eebac1e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:53.415240 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e0bd7bcf-b883-4ea2-b5fa-0b999eebac1e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:53.415870 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e0bd7bcf-b883-4ea2-b5fa-0b999eebac1e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:53.417916 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e0bd7bcf-b883-4ea2-b5fa-0b999eebac1e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:53.418381 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e0bd7bcf-b883-4ea2-b5fa-0b999eebac1e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:53.418811 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e0bd7bcf-b883-4ea2-b5fa-0b999eebac1e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:53.561777 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-e0bd7bcf-b883-4ea2-b5fa-0b999eebac1e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:53.570016 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-e0bd7bcf-b883-4ea2-b5fa-0b999eebac1e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:53.571525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-e0bd7bcf-b883-4ea2-b5fa-0b999eebac1e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:53.573326 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-e0bd7bcf-b883-4ea2-b5fa-0b999eebac1e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1408 microversion: 2.20 time: 0.169219 Sep 23 15:20:53.574075 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 57/129] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:20:53 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:20:53.722991 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-8f64e90b-eabe-4b58-99eb-f5ed0b977120 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:53.723658 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-8f64e90b-eabe-4b58-99eb-f5ed0b977120 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:53.730301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8f64e90b-eabe-4b58-99eb-f5ed0b977120 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:53.730802 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8f64e90b-eabe-4b58-99eb-f5ed0b977120 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:53.731231 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8f64e90b-eabe-4b58-99eb-f5ed0b977120 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:53.731928 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8f64e90b-eabe-4b58-99eb-f5ed0b977120 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:53.732457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8f64e90b-eabe-4b58-99eb-f5ed0b977120 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:53.732887 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8f64e90b-eabe-4b58-99eb-f5ed0b977120 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:53.782261 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-5689cdb3-0488-4162-bd0d-ac829a229838 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:53.782942 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-5689cdb3-0488-4162-bd0d-ac829a229838 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:53.789786 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5689cdb3-0488-4162-bd0d-ac829a229838 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:53.790274 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5689cdb3-0488-4162-bd0d-ac829a229838 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:53.790876 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5689cdb3-0488-4162-bd0d-ac829a229838 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:53.791861 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5689cdb3-0488-4162-bd0d-ac829a229838 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:53.792482 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5689cdb3-0488-4162-bd0d-ac829a229838 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:53.793134 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5689cdb3-0488-4162-bd0d-ac829a229838 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:53.932460 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-8f64e90b-eabe-4b58-99eb-f5ed0b977120 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:53.942209 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-8f64e90b-eabe-4b58-99eb-f5ed0b977120 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1363 microversion: 2.1 time: 0.223389 Sep 23 15:20:53.942808 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 73/130] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:53 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:54.009364 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-5689cdb3-0488-4162-bd0d-ac829a229838 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:54.010572 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-5689cdb3-0488-4162-bd0d-ac829a229838 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1314 microversion: 2.1 time: 0.234304 Sep 23 15:20:54.011190 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 58/131] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:53 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:54.405738 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-df0f32cb-a306-4940-8fd4-8116deadd842 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:54.406345 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-df0f32cb-a306-4940-8fd4-8116deadd842 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:54.412661 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-df0f32cb-a306-4940-8fd4-8116deadd842 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:54.413156 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-df0f32cb-a306-4940-8fd4-8116deadd842 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:54.413706 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-df0f32cb-a306-4940-8fd4-8116deadd842 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:54.414429 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-df0f32cb-a306-4940-8fd4-8116deadd842 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:54.414884 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-df0f32cb-a306-4940-8fd4-8116deadd842 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:54.415339 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-df0f32cb-a306-4940-8fd4-8116deadd842 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:54.681007 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-df0f32cb-a306-4940-8fd4-8116deadd842 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:54.681007 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-df0f32cb-a306-4940-8fd4-8116deadd842 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1322 microversion: 2.1 time: 0.174167 Sep 23 15:20:54.681007 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 74/132] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:54 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:54.681540 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a14811af-cd64-4d96-882a-8c23d4026626 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:54.681540 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-a14811af-cd64-4d96-882a-8c23d4026626 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:54.681540 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a14811af-cd64-4d96-882a-8c23d4026626 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:54.681540 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a14811af-cd64-4d96-882a-8c23d4026626 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:54.682808 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a14811af-cd64-4d96-882a-8c23d4026626 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:54.682808 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a14811af-cd64-4d96-882a-8c23d4026626 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:54.682808 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a14811af-cd64-4d96-882a-8c23d4026626 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:54.682808 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a14811af-cd64-4d96-882a-8c23d4026626 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:54.741565 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a14811af-cd64-4d96-882a-8c23d4026626 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:54.750483 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a14811af-cd64-4d96-882a-8c23d4026626 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:54.751918 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a14811af-cd64-4d96-882a-8c23d4026626 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:54.753087 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-a14811af-cd64-4d96-882a-8c23d4026626 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1408 microversion: 2.20 time: 0.158215 Sep 23 15:20:54.753626 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 59/133] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:20:54 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:20:54.967873 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-1a27c56a-b671-47a5-985e-3a281e54c1d9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:54.968419 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-1a27c56a-b671-47a5-985e-3a281e54c1d9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:54.974841 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1a27c56a-b671-47a5-985e-3a281e54c1d9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:54.977447 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1a27c56a-b671-47a5-985e-3a281e54c1d9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:54.977447 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1a27c56a-b671-47a5-985e-3a281e54c1d9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:54.977447 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1a27c56a-b671-47a5-985e-3a281e54c1d9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:54.977447 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1a27c56a-b671-47a5-985e-3a281e54c1d9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:54.977800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1a27c56a-b671-47a5-985e-3a281e54c1d9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:55.034074 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-f8d8e886-577d-48dd-a228-19e206c8adee tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:55.039437 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-f8d8e886-577d-48dd-a228-19e206c8adee tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:55.040932 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f8d8e886-577d-48dd-a228-19e206c8adee tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:55.042146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f8d8e886-577d-48dd-a228-19e206c8adee tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:55.043002 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f8d8e886-577d-48dd-a228-19e206c8adee tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:55.044175 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f8d8e886-577d-48dd-a228-19e206c8adee tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:55.044681 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f8d8e886-577d-48dd-a228-19e206c8adee tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:55.045113 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f8d8e886-577d-48dd-a228-19e206c8adee tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:55.111851 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-1a27c56a-b671-47a5-985e-3a281e54c1d9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:55.120736 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-1a27c56a-b671-47a5-985e-3a281e54c1d9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1363 microversion: 2.1 time: 0.156678 Sep 23 15:20:55.121409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 75/134] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:54 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:55.188881 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-f8d8e886-577d-48dd-a228-19e206c8adee tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:55.196797 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-f8d8e886-577d-48dd-a228-19e206c8adee tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1314 microversion: 2.1 time: 0.166781 Sep 23 15:20:55.200258 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 60/135] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:55 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:55.670793 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-10d6f699-539b-40f4-b5b7-0ea41206f912 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:55.671585 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-10d6f699-539b-40f4-b5b7-0ea41206f912 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:55.677698 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-10d6f699-539b-40f4-b5b7-0ea41206f912 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:55.678180 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-10d6f699-539b-40f4-b5b7-0ea41206f912 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:55.678614 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-10d6f699-539b-40f4-b5b7-0ea41206f912 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:55.679307 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-10d6f699-539b-40f4-b5b7-0ea41206f912 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:55.679756 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-10d6f699-539b-40f4-b5b7-0ea41206f912 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:55.680229 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-10d6f699-539b-40f4-b5b7-0ea41206f912 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:55.779344 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-21100dca-ded4-449a-9f12-e1e11e516d74 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:55.779957 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-21100dca-ded4-449a-9f12-e1e11e516d74 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:55.786037 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-21100dca-ded4-449a-9f12-e1e11e516d74 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:55.786538 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-21100dca-ded4-449a-9f12-e1e11e516d74 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:55.786961 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-21100dca-ded4-449a-9f12-e1e11e516d74 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:55.787652 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-21100dca-ded4-449a-9f12-e1e11e516d74 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:55.788173 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-21100dca-ded4-449a-9f12-e1e11e516d74 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:55.788564 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-21100dca-ded4-449a-9f12-e1e11e516d74 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:55.817868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-10d6f699-539b-40f4-b5b7-0ea41206f912 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:55.830033 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-10d6f699-539b-40f4-b5b7-0ea41206f912 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1322 microversion: 2.1 time: 0.163799 Sep 23 15:20:55.830622 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 76/136] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:55 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:55.970815 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-21100dca-ded4-449a-9f12-e1e11e516d74 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:55.983457 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-21100dca-ded4-449a-9f12-e1e11e516d74 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:55.985047 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-21100dca-ded4-449a-9f12-e1e11e516d74 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:55.986093 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-21100dca-ded4-449a-9f12-e1e11e516d74 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1408 microversion: 2.20 time: 0.211247 Sep 23 15:20:55.986654 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 61/137] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:20:55 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1408 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:20:56.144116 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-eb3489ca-02a4-4720-99d4-de02ef3f4d33 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:56.144732 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-eb3489ca-02a4-4720-99d4-de02ef3f4d33 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:56.151474 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eb3489ca-02a4-4720-99d4-de02ef3f4d33 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:56.152230 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eb3489ca-02a4-4720-99d4-de02ef3f4d33 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:56.152664 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eb3489ca-02a4-4720-99d4-de02ef3f4d33 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:56.153355 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eb3489ca-02a4-4720-99d4-de02ef3f4d33 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:56.153804 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eb3489ca-02a4-4720-99d4-de02ef3f4d33 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:56.154220 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eb3489ca-02a4-4720-99d4-de02ef3f4d33 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:56.231424 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-81217e19-a7c3-4fc1-99fc-026e8f0983df tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:56.235294 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-81217e19-a7c3-4fc1-99fc-026e8f0983df tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:56.256070 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-81217e19-a7c3-4fc1-99fc-026e8f0983df tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:56.256978 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-81217e19-a7c3-4fc1-99fc-026e8f0983df tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:56.258141 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-81217e19-a7c3-4fc1-99fc-026e8f0983df tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:56.259065 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-81217e19-a7c3-4fc1-99fc-026e8f0983df tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:56.260442 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-81217e19-a7c3-4fc1-99fc-026e8f0983df tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:56.261648 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-81217e19-a7c3-4fc1-99fc-026e8f0983df tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:56.316619 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-eb3489ca-02a4-4720-99d4-de02ef3f4d33 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:56.327053 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-eb3489ca-02a4-4720-99d4-de02ef3f4d33 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1363 microversion: 2.1 time: 0.187076 Sep 23 15:20:56.328768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 77/138] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:56 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:56.467670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-81217e19-a7c3-4fc1-99fc-026e8f0983df tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:56.484717 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-81217e19-a7c3-4fc1-99fc-026e8f0983df tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1314 microversion: 2.1 time: 0.267402 Sep 23 15:20:56.485382 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 62/139] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:56 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:56.774078 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-d25ee6de-c983-4da8-8fe1-0b6768578795 req-bf164ca5-0228-499a-80b3-3aabb21deb6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e7c6dbd-a4f4-4fd8-a719-38705c323809", "name": "network-vif-plugged", "status": "completed", "tag": "d891c01a-6a8c-4f04-ae61-1c13c3cb2ed1"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:20:56.790020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-d25ee6de-c983-4da8-8fe1-0b6768578795 req-bf164ca5-0228-499a-80b3-3aabb21deb6e service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:56.790500 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-d25ee6de-c983-4da8-8fe1-0b6768578795 req-bf164ca5-0228-499a-80b3-3aabb21deb6e service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:56.791476 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-d25ee6de-c983-4da8-8fe1-0b6768578795 req-bf164ca5-0228-499a-80b3-3aabb21deb6e service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:56.808553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-d25ee6de-c983-4da8-8fe1-0b6768578795 req-bf164ca5-0228-499a-80b3-3aabb21deb6e service nova] Creating event network-vif-plugged:d891c01a-6a8c-4f04-ae61-1c13c3cb2ed1 for instance 3e7c6dbd-a4f4-4fd8-a719-38705c323809 on hv-cinder-85530 Sep 23 15:20:56.814195 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-d25ee6de-c983-4da8-8fe1-0b6768578795 req-bf164ca5-0228-499a-80b3-3aabb21deb6e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126148 Sep 23 15:20:56.815413 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 78/140] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:20:56.855364 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-102d3d0a-98cd-4155-b50c-287944184f90 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:56.856096 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-102d3d0a-98cd-4155-b50c-287944184f90 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:56.864014 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-102d3d0a-98cd-4155-b50c-287944184f90 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:56.864788 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-102d3d0a-98cd-4155-b50c-287944184f90 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:56.865420 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-102d3d0a-98cd-4155-b50c-287944184f90 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:56.866412 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-102d3d0a-98cd-4155-b50c-287944184f90 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:56.867069 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-102d3d0a-98cd-4155-b50c-287944184f90 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:56.867861 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-102d3d0a-98cd-4155-b50c-287944184f90 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:57.013527 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-102d3d0a-98cd-4155-b50c-287944184f90 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:57.015547 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-5e03b510-f914-47cc-a7e7-62efa70b1a2a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:57.016490 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-5e03b510-f914-47cc-a7e7-62efa70b1a2a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:57.028983 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5e03b510-f914-47cc-a7e7-62efa70b1a2a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:57.040976 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5e03b510-f914-47cc-a7e7-62efa70b1a2a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:57.040976 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5e03b510-f914-47cc-a7e7-62efa70b1a2a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:57.040976 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5e03b510-f914-47cc-a7e7-62efa70b1a2a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:57.040976 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5e03b510-f914-47cc-a7e7-62efa70b1a2a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:57.042731 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5e03b510-f914-47cc-a7e7-62efa70b1a2a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:57.042909 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-102d3d0a-98cd-4155-b50c-287944184f90 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1322 microversion: 2.1 time: 0.191083 Sep 23 15:20:57.052189 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 63/141] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:56 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:57.186771 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-5e03b510-f914-47cc-a7e7-62efa70b1a2a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:57.194834 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-5e03b510-f914-47cc-a7e7-62efa70b1a2a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:57.196330 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-5e03b510-f914-47cc-a7e7-62efa70b1a2a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:57.197496 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-5e03b510-f914-47cc-a7e7-62efa70b1a2a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1408 microversion: 2.20 time: 0.187158 Sep 23 15:20:57.198047 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 79/142] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:20:57 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:20:57.353325 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-361ca7e9-1754-48d0-b5bd-0e07ea038764 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:57.354242 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-361ca7e9-1754-48d0-b5bd-0e07ea038764 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:57.360739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-361ca7e9-1754-48d0-b5bd-0e07ea038764 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:57.361217 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-361ca7e9-1754-48d0-b5bd-0e07ea038764 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:57.361839 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-361ca7e9-1754-48d0-b5bd-0e07ea038764 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:57.362705 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-361ca7e9-1754-48d0-b5bd-0e07ea038764 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:57.363583 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-361ca7e9-1754-48d0-b5bd-0e07ea038764 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:57.364355 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-361ca7e9-1754-48d0-b5bd-0e07ea038764 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:57.509457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-c77d521f-e70a-4c2a-973f-6d197a893690 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:57.510298 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-c77d521f-e70a-4c2a-973f-6d197a893690 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:57.534300 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c77d521f-e70a-4c2a-973f-6d197a893690 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:57.534300 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c77d521f-e70a-4c2a-973f-6d197a893690 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:57.534300 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c77d521f-e70a-4c2a-973f-6d197a893690 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:57.534300 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c77d521f-e70a-4c2a-973f-6d197a893690 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:57.534876 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c77d521f-e70a-4c2a-973f-6d197a893690 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:57.534876 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c77d521f-e70a-4c2a-973f-6d197a893690 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:57.550841 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-361ca7e9-1754-48d0-b5bd-0e07ea038764 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:57.563280 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-361ca7e9-1754-48d0-b5bd-0e07ea038764 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1363 microversion: 2.1 time: 0.214043 Sep 23 15:20:57.564233 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 64/143] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:57 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:57.820105 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-c77d521f-e70a-4c2a-973f-6d197a893690 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:57.826283 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=100 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:57.832999 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-c77d521f-e70a-4c2a-973f-6d197a893690 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1314 microversion: 2.1 time: 0.327624 Sep 23 15:20:57.834224 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 80/144] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:57 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:58.069326 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-5e6bc508-a93b-4081-89fc-0842db66fcc1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:58.070269 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-5e6bc508-a93b-4081-89fc-0842db66fcc1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:58.079765 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5e6bc508-a93b-4081-89fc-0842db66fcc1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:58.080777 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5e6bc508-a93b-4081-89fc-0842db66fcc1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:58.081486 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5e6bc508-a93b-4081-89fc-0842db66fcc1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:58.082537 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5e6bc508-a93b-4081-89fc-0842db66fcc1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:58.083204 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5e6bc508-a93b-4081-89fc-0842db66fcc1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:58.083831 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5e6bc508-a93b-4081-89fc-0842db66fcc1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:58.221328 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-5075ccbb-2dec-46e1-8e82-8e5c80a69f37 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:58.229887 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-5075ccbb-2dec-46e1-8e82-8e5c80a69f37 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:58.231547 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5075ccbb-2dec-46e1-8e82-8e5c80a69f37 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:58.232069 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5075ccbb-2dec-46e1-8e82-8e5c80a69f37 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:58.232694 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5075ccbb-2dec-46e1-8e82-8e5c80a69f37 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:58.233560 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5075ccbb-2dec-46e1-8e82-8e5c80a69f37 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:58.234279 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5075ccbb-2dec-46e1-8e82-8e5c80a69f37 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:58.234884 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5075ccbb-2dec-46e1-8e82-8e5c80a69f37 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:58.275212 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-5e6bc508-a93b-4081-89fc-0842db66fcc1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:58.287154 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-5e6bc508-a93b-4081-89fc-0842db66fcc1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1322 microversion: 2.1 time: 0.219860 Sep 23 15:20:58.296539 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 65/145] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:58 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:58.412631 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-5075ccbb-2dec-46e1-8e82-8e5c80a69f37 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:58.421585 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-5075ccbb-2dec-46e1-8e82-8e5c80a69f37 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:58.423060 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-5075ccbb-2dec-46e1-8e82-8e5c80a69f37 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:58.425107 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-5075ccbb-2dec-46e1-8e82-8e5c80a69f37 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1408 microversion: 2.20 time: 0.207636 Sep 23 15:20:58.426606 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 81/146] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:20:58 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1408 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:20:58.594040 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-fcd6f1d3-c7a7-45fa-8534-090fee8660fd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:58.594909 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-fcd6f1d3-c7a7-45fa-8534-090fee8660fd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:58.604047 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fcd6f1d3-c7a7-45fa-8534-090fee8660fd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:58.604791 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fcd6f1d3-c7a7-45fa-8534-090fee8660fd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:58.605412 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fcd6f1d3-c7a7-45fa-8534-090fee8660fd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:58.606523 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fcd6f1d3-c7a7-45fa-8534-090fee8660fd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:58.608525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fcd6f1d3-c7a7-45fa-8534-090fee8660fd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:58.609669 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fcd6f1d3-c7a7-45fa-8534-090fee8660fd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:58.787769 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-fcd6f1d3-c7a7-45fa-8534-090fee8660fd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:58.797086 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-fcd6f1d3-c7a7-45fa-8534-090fee8660fd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1363 microversion: 2.1 time: 0.206964 Sep 23 15:20:58.797683 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 66/147] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:58 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:58.836521 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-91919324-ee2c-46cb-a2a2-239b28f1ffd9 req-1299b0ca-e260-4eaa-8cee-aed7aca1c307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5523ab-9085-47cd-9133-f65554b59f0f", "name": "network-vif-plugged", "status": "completed", "tag": "55424de1-677b-4c57-a21b-d9eb905f5fc7"}, {"server_uuid": "53291dd1-3df2-438e-a2aa-80fa4e76245c", "name": "network-vif-plugged", "status": "completed", "tag": "0ac971ff-aa73-4c23-905e-b603461ad30f"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:20:58.850068 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-91919324-ee2c-46cb-a2a2-239b28f1ffd9 req-1299b0ca-e260-4eaa-8cee-aed7aca1c307 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:58.850662 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-91919324-ee2c-46cb-a2a2-239b28f1ffd9 req-1299b0ca-e260-4eaa-8cee-aed7aca1c307 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:58.851191 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-91919324-ee2c-46cb-a2a2-239b28f1ffd9 req-1299b0ca-e260-4eaa-8cee-aed7aca1c307 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:58.859121 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-5631b0f6-26a1-41a8-ad4c-ee26201d35eb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:58.859730 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-5631b0f6-26a1-41a8-ad4c-ee26201d35eb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:58.870765 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5631b0f6-26a1-41a8-ad4c-ee26201d35eb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:58.871255 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5631b0f6-26a1-41a8-ad4c-ee26201d35eb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:58.871688 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5631b0f6-26a1-41a8-ad4c-ee26201d35eb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:58.872420 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5631b0f6-26a1-41a8-ad4c-ee26201d35eb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:58.872867 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5631b0f6-26a1-41a8-ad4c-ee26201d35eb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:58.873282 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5631b0f6-26a1-41a8-ad4c-ee26201d35eb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:58.887887 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-91919324-ee2c-46cb-a2a2-239b28f1ffd9 req-1299b0ca-e260-4eaa-8cee-aed7aca1c307 service nova] Creating event network-vif-plugged:55424de1-677b-4c57-a21b-d9eb905f5fc7 for instance 1c5523ab-9085-47cd-9133-f65554b59f0f on hv-cinder-85530 Sep 23 15:20:58.891095 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-91919324-ee2c-46cb-a2a2-239b28f1ffd9 req-1299b0ca-e260-4eaa-8cee-aed7aca1c307 service nova] Creating event network-vif-plugged:0ac971ff-aa73-4c23-905e-b603461ad30f for instance 53291dd1-3df2-438e-a2aa-80fa4e76245c on hv-cinder-85530 Sep 23 15:20:58.903604 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-91919324-ee2c-46cb-a2a2-239b28f1ffd9 req-1299b0ca-e260-4eaa-8cee-aed7aca1c307 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.073514 Sep 23 15:20:58.906509 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 82/148] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:20:59.061625 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-5631b0f6-26a1-41a8-ad4c-ee26201d35eb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:59.070604 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-5631b0f6-26a1-41a8-ad4c-ee26201d35eb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1314 microversion: 2.1 time: 0.215231 Sep 23 15:20:59.072307 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 67/149] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:58 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:59.307669 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-d2085360-f35e-4993-a9e2-e56a1dd1df60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:59.308399 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-d2085360-f35e-4993-a9e2-e56a1dd1df60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:59.314676 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d2085360-f35e-4993-a9e2-e56a1dd1df60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:59.315152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d2085360-f35e-4993-a9e2-e56a1dd1df60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:59.315582 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d2085360-f35e-4993-a9e2-e56a1dd1df60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:59.316291 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d2085360-f35e-4993-a9e2-e56a1dd1df60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:59.316741 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d2085360-f35e-4993-a9e2-e56a1dd1df60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:59.317161 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d2085360-f35e-4993-a9e2-e56a1dd1df60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:59.451743 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-d407038c-395a-4423-9dd2-3dea55aa1940 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:59.452517 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-d407038c-395a-4423-9dd2-3dea55aa1940 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:59.461853 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d407038c-395a-4423-9dd2-3dea55aa1940 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:59.464514 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d407038c-395a-4423-9dd2-3dea55aa1940 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:59.465968 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d407038c-395a-4423-9dd2-3dea55aa1940 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:59.468583 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d407038c-395a-4423-9dd2-3dea55aa1940 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:59.470777 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d407038c-395a-4423-9dd2-3dea55aa1940 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:59.472279 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d407038c-395a-4423-9dd2-3dea55aa1940 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:59.499915 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=100 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:59.502716 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-d2085360-f35e-4993-a9e2-e56a1dd1df60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:59.511746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-d2085360-f35e-4993-a9e2-e56a1dd1df60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1322 microversion: 2.1 time: 0.208712 Sep 23 15:20:59.513104 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 83/150] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:59 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:59.630100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-d407038c-395a-4423-9dd2-3dea55aa1940 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:59.633973 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-d407038c-395a-4423-9dd2-3dea55aa1940 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:59.636219 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-d407038c-395a-4423-9dd2-3dea55aa1940 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:59.637332 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-d407038c-395a-4423-9dd2-3dea55aa1940 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1408 microversion: 2.20 time: 0.190417 Sep 23 15:20:59.637895 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 68/151] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:20:59 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1408 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:20:59.820879 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-455f512a-ca53-4003-a64e-00349371d86c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:59.821525 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-455f512a-ca53-4003-a64e-00349371d86c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:59.828634 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-455f512a-ca53-4003-a64e-00349371d86c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:59.829120 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-455f512a-ca53-4003-a64e-00349371d86c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:59.829597 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-455f512a-ca53-4003-a64e-00349371d86c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:59.830284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-455f512a-ca53-4003-a64e-00349371d86c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:59.830815 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-455f512a-ca53-4003-a64e-00349371d86c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:59.831235 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-455f512a-ca53-4003-a64e-00349371d86c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:00.096752 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-e0a44129-20fb-42e2-bee4-b11849fea042 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:00.098011 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-e0a44129-20fb-42e2-bee4-b11849fea042 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:00.109450 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e0a44129-20fb-42e2-bee4-b11849fea042 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:00.119425 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e0a44129-20fb-42e2-bee4-b11849fea042 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:00.120646 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e0a44129-20fb-42e2-bee4-b11849fea042 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:00.122261 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e0a44129-20fb-42e2-bee4-b11849fea042 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:00.122892 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e0a44129-20fb-42e2-bee4-b11849fea042 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:00.123490 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e0a44129-20fb-42e2-bee4-b11849fea042 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:00.173913 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-455f512a-ca53-4003-a64e-00349371d86c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:00.181849 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-455f512a-ca53-4003-a64e-00349371d86c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1363 microversion: 2.1 time: 0.364693 Sep 23 15:21:00.186414 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 84/152] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:59 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1363 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:00.326030 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-e0a44129-20fb-42e2-bee4-b11849fea042 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:00.334283 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-e0a44129-20fb-42e2-bee4-b11849fea042 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1314 microversion: 2.1 time: 0.241716 Sep 23 15:21:00.334892 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 69/153] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:00 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:21:00.535485 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-0a37e008-e5a9-4ddc-9509-156ae2720e3c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:00.536120 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-0a37e008-e5a9-4ddc-9509-156ae2720e3c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:00.542139 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0a37e008-e5a9-4ddc-9509-156ae2720e3c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:00.542613 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0a37e008-e5a9-4ddc-9509-156ae2720e3c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:00.543039 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0a37e008-e5a9-4ddc-9509-156ae2720e3c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:00.543711 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0a37e008-e5a9-4ddc-9509-156ae2720e3c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:00.544200 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0a37e008-e5a9-4ddc-9509-156ae2720e3c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:00.544605 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0a37e008-e5a9-4ddc-9509-156ae2720e3c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:00.665072 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a43d55d0-36ba-4f0f-9fde-6c06230879ca tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:00.665905 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-a43d55d0-36ba-4f0f-9fde-6c06230879ca tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:00.672160 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a43d55d0-36ba-4f0f-9fde-6c06230879ca tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:00.672916 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a43d55d0-36ba-4f0f-9fde-6c06230879ca tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:00.673358 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a43d55d0-36ba-4f0f-9fde-6c06230879ca tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:00.674057 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a43d55d0-36ba-4f0f-9fde-6c06230879ca tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:00.675008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a43d55d0-36ba-4f0f-9fde-6c06230879ca tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:00.675220 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a43d55d0-36ba-4f0f-9fde-6c06230879ca tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:00.717750 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-0a37e008-e5a9-4ddc-9509-156ae2720e3c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:00.730931 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-0a37e008-e5a9-4ddc-9509-156ae2720e3c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1517 microversion: 2.1 time: 0.199211 Sep 23 15:21:00.732125 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 85/154] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:00 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1517 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:00.758353 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-202a2901-5894-4648-9525-38ce3726f087 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:21:00.764029 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-202a2901-5894-4648-9525-38ce3726f087 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:00.780569 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-202a2901-5894-4648-9525-38ce3726f087 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:00.781326 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-202a2901-5894-4648-9525-38ce3726f087 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:00.781797 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-202a2901-5894-4648-9525-38ce3726f087 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:00.782699 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-202a2901-5894-4648-9525-38ce3726f087 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:00.783317 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-202a2901-5894-4648-9525-38ce3726f087 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:00.783910 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-202a2901-5894-4648-9525-38ce3726f087 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:00.863504 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.objects.instance [None req-202a2901-5894-4648-9525-38ce3726f087 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lazy-loading 'flavor' on Instance uuid 3e7c6dbd-a4f4-4fd8-a719-38705c323809 {{(pid=121450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:21:00.888517 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a43d55d0-36ba-4f0f-9fde-6c06230879ca tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:00.897962 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a43d55d0-36ba-4f0f-9fde-6c06230879ca tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:00.901579 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a43d55d0-36ba-4f0f-9fde-6c06230879ca tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:00.903728 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-a43d55d0-36ba-4f0f-9fde-6c06230879ca tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1408 microversion: 2.20 time: 0.242440 Sep 23 15:21:00.904639 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 70/155] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:21:00 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1408 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:21:00.925164 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-71fb208f-75b7-42e4-9a2d-22ee35df1c47 req-07f61057-8f51-47b7-9e4b-cb0d1c0e9d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bba6fdd-bec4-491e-81ba-f3a9863f72ca", "name": "network-vif-plugged", "status": "completed", "tag": "8801bad0-f531-42e9-8015-b0d63a8e4f8e"}, {"server_uuid": "878c924c-fcc8-4dbf-8ea1-132f142e0422", "name": "network-vif-plugged", "status": "completed", "tag": "fdb860b5-e215-4e14-8b93-274f42416008"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:21:00.931574 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_api:SELECT=100 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:21:00.936081 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-71fb208f-75b7-42e4-9a2d-22ee35df1c47 req-07f61057-8f51-47b7-9e4b-cb0d1c0e9d30 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:00.936632 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-71fb208f-75b7-42e4-9a2d-22ee35df1c47 req-07f61057-8f51-47b7-9e4b-cb0d1c0e9d30 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:00.937128 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-71fb208f-75b7-42e4-9a2d-22ee35df1c47 req-07f61057-8f51-47b7-9e4b-cb0d1c0e9d30 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:00.950787 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-71fb208f-75b7-42e4-9a2d-22ee35df1c47 req-07f61057-8f51-47b7-9e4b-cb0d1c0e9d30 service nova] Creating event network-vif-plugged:8801bad0-f531-42e9-8015-b0d63a8e4f8e for instance 4bba6fdd-bec4-491e-81ba-f3a9863f72ca on hv-cinder-85530 Sep 23 15:21:00.951256 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-71fb208f-75b7-42e4-9a2d-22ee35df1c47 req-07f61057-8f51-47b7-9e4b-cb0d1c0e9d30 service nova] Creating event network-vif-plugged:fdb860b5-e215-4e14-8b93-274f42416008 for instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 on hv-cinder-85530 Sep 23 15:21:00.958014 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-71fb208f-75b7-42e4-9a2d-22ee35df1c47 req-07f61057-8f51-47b7-9e4b-cb0d1c0e9d30 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036407 Sep 23 15:21:00.961828 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 71/156] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:21:01.210263 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-bb6e0cad-2500-412b-9276-4636338a076b tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:01.211897 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-bb6e0cad-2500-412b-9276-4636338a076b tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:01.219260 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bb6e0cad-2500-412b-9276-4636338a076b tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:01.219743 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bb6e0cad-2500-412b-9276-4636338a076b tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:01.220210 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bb6e0cad-2500-412b-9276-4636338a076b tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:01.220914 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bb6e0cad-2500-412b-9276-4636338a076b tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:01.221477 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bb6e0cad-2500-412b-9276-4636338a076b tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:01.221891 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bb6e0cad-2500-412b-9276-4636338a076b tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:01.251539 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-202a2901-5894-4648-9525-38ce3726f087 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "POST /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809/action" status: 200 len: 32 microversion: 2.1 time: 0.497161 Sep 23 15:21:01.265112 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 86/157] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Sep 23 15:21:00 2022] POST /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809/action => generated 32 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 15:21:01.270143 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-5dfeef86-3d3d-4030-a891-a69c7112053a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:01.271768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-5dfeef86-3d3d-4030-a891-a69c7112053a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:01.284621 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5dfeef86-3d3d-4030-a891-a69c7112053a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:01.286687 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5dfeef86-3d3d-4030-a891-a69c7112053a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:01.287651 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5dfeef86-3d3d-4030-a891-a69c7112053a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:01.288935 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5dfeef86-3d3d-4030-a891-a69c7112053a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:01.289582 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5dfeef86-3d3d-4030-a891-a69c7112053a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:01.290194 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5dfeef86-3d3d-4030-a891-a69c7112053a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:01.475316 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-5dfeef86-3d3d-4030-a891-a69c7112053a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:01.485457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-5dfeef86-3d3d-4030-a891-a69c7112053a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.223499 Sep 23 15:21:01.493246 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 87/158] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:01 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:01.502784 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-00631e7a-3f1d-4dca-b72e-436f4d32debe tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:01.503607 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-00631e7a-3f1d-4dca-b72e-436f4d32debe tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:01.510531 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-bb6e0cad-2500-412b-9276-4636338a076b tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:01.510700 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-00631e7a-3f1d-4dca-b72e-436f4d32debe tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:01.511406 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-00631e7a-3f1d-4dca-b72e-436f4d32debe tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:01.512113 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-00631e7a-3f1d-4dca-b72e-436f4d32debe tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:01.513226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-00631e7a-3f1d-4dca-b72e-436f4d32debe tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:01.514163 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-00631e7a-3f1d-4dca-b72e-436f4d32debe tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:01.514682 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-00631e7a-3f1d-4dca-b72e-436f4d32debe tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:01.521324 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-bb6e0cad-2500-412b-9276-4636338a076b tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1363 microversion: 2.1 time: 0.314921 Sep 23 15:21:01.579158 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 72/159] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:01 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:21:01.649423 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-00631e7a-3f1d-4dca-b72e-436f4d32debe tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:01.658681 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-00631e7a-3f1d-4dca-b72e-436f4d32debe tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1314 microversion: 2.1 time: 0.164085 Sep 23 15:21:01.659318 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 88/160] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:01 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:01.932675 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-5049c0a1-9d8a-4a8b-8b71-34cf0befa3c4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:01.933292 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-5049c0a1-9d8a-4a8b-8b71-34cf0befa3c4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:01.939413 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5049c0a1-9d8a-4a8b-8b71-34cf0befa3c4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:01.939877 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5049c0a1-9d8a-4a8b-8b71-34cf0befa3c4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:01.940343 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5049c0a1-9d8a-4a8b-8b71-34cf0befa3c4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:01.941040 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5049c0a1-9d8a-4a8b-8b71-34cf0befa3c4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:01.941491 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5049c0a1-9d8a-4a8b-8b71-34cf0befa3c4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:01.941917 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5049c0a1-9d8a-4a8b-8b71-34cf0befa3c4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:02.092381 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-5049c0a1-9d8a-4a8b-8b71-34cf0befa3c4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:02.100515 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-5049c0a1-9d8a-4a8b-8b71-34cf0befa3c4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:02.102009 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-5049c0a1-9d8a-4a8b-8b71-34cf0befa3c4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:02.103574 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-5049c0a1-9d8a-4a8b-8b71-34cf0befa3c4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1408 microversion: 2.20 time: 0.177331 Sep 23 15:21:02.116000 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 73/161] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:21:01 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:21:02.512600 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-4e5c6add-b46e-4f99-b00c-ca0456ed9f58 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:02.513159 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-4e5c6add-b46e-4f99-b00c-ca0456ed9f58 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:02.519448 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4e5c6add-b46e-4f99-b00c-ca0456ed9f58 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:02.519930 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4e5c6add-b46e-4f99-b00c-ca0456ed9f58 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:02.520400 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4e5c6add-b46e-4f99-b00c-ca0456ed9f58 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:02.521158 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4e5c6add-b46e-4f99-b00c-ca0456ed9f58 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:02.521610 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4e5c6add-b46e-4f99-b00c-ca0456ed9f58 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:02.522031 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4e5c6add-b46e-4f99-b00c-ca0456ed9f58 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:02.601528 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-158ad412-cfe2-4fcf-ad76-a34f6daf8153 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:02.602826 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-158ad412-cfe2-4fcf-ad76-a34f6daf8153 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:02.612708 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-158ad412-cfe2-4fcf-ad76-a34f6daf8153 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:02.613495 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-158ad412-cfe2-4fcf-ad76-a34f6daf8153 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:02.614249 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-158ad412-cfe2-4fcf-ad76-a34f6daf8153 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:02.615117 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-158ad412-cfe2-4fcf-ad76-a34f6daf8153 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:02.615726 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-158ad412-cfe2-4fcf-ad76-a34f6daf8153 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:02.616503 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-158ad412-cfe2-4fcf-ad76-a34f6daf8153 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:02.678071 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-4e5c6add-b46e-4f99-b00c-ca0456ed9f58 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:02.688968 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-4e5c6add-b46e-4f99-b00c-ca0456ed9f58 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.182535 Sep 23 15:21:02.690288 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 89/162] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:02 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:02.695922 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-92fb4ba3-3d90-4389-b089-0ee950c5e553 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:02.696832 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-92fb4ba3-3d90-4389-b089-0ee950c5e553 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:02.710004 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-92fb4ba3-3d90-4389-b089-0ee950c5e553 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:02.710493 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-92fb4ba3-3d90-4389-b089-0ee950c5e553 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:02.710948 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-92fb4ba3-3d90-4389-b089-0ee950c5e553 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:02.711799 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-92fb4ba3-3d90-4389-b089-0ee950c5e553 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:02.712323 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-92fb4ba3-3d90-4389-b089-0ee950c5e553 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:02.712748 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-92fb4ba3-3d90-4389-b089-0ee950c5e553 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:02.793537 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-158ad412-cfe2-4fcf-ad76-a34f6daf8153 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:02.801555 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-158ad412-cfe2-4fcf-ad76-a34f6daf8153 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1363 microversion: 2.1 time: 0.204110 Sep 23 15:21:02.802139 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 74/163] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:02 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:21:02.857879 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-92fb4ba3-3d90-4389-b089-0ee950c5e553 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:02.865909 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-92fb4ba3-3d90-4389-b089-0ee950c5e553 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1314 microversion: 2.1 time: 0.174087 Sep 23 15:21:02.866479 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 90/164] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:02 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:03.130029 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-db6c3b26-492e-4ced-aea2-8349c219e863 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:03.130884 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-db6c3b26-492e-4ced-aea2-8349c219e863 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:03.137462 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-db6c3b26-492e-4ced-aea2-8349c219e863 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:03.137960 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-db6c3b26-492e-4ced-aea2-8349c219e863 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:03.138696 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-db6c3b26-492e-4ced-aea2-8349c219e863 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:03.139436 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-db6c3b26-492e-4ced-aea2-8349c219e863 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:03.140039 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-db6c3b26-492e-4ced-aea2-8349c219e863 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:03.140333 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-db6c3b26-492e-4ced-aea2-8349c219e863 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:03.284938 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-db6c3b26-492e-4ced-aea2-8349c219e863 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:03.294038 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-db6c3b26-492e-4ced-aea2-8349c219e863 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:03.295570 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-db6c3b26-492e-4ced-aea2-8349c219e863 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:03.296656 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-db6c3b26-492e-4ced-aea2-8349c219e863 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1408 microversion: 2.20 time: 0.170730 Sep 23 15:21:03.297931 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 75/165] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:21:03 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:21:03.716120 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-49f266f4-598c-417b-96d6-bd8a21cd77c4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:03.716760 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-49f266f4-598c-417b-96d6-bd8a21cd77c4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:03.722781 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-49f266f4-598c-417b-96d6-bd8a21cd77c4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:03.723284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-49f266f4-598c-417b-96d6-bd8a21cd77c4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:03.723740 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-49f266f4-598c-417b-96d6-bd8a21cd77c4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:03.724459 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-49f266f4-598c-417b-96d6-bd8a21cd77c4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:03.724910 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-49f266f4-598c-417b-96d6-bd8a21cd77c4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:03.725333 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-49f266f4-598c-417b-96d6-bd8a21cd77c4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:03.826429 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-3e619d8c-2ad7-468f-a783-0389ba232a56 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:03.827628 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-3e619d8c-2ad7-468f-a783-0389ba232a56 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:03.838041 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3e619d8c-2ad7-468f-a783-0389ba232a56 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:03.838782 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3e619d8c-2ad7-468f-a783-0389ba232a56 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:03.839363 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3e619d8c-2ad7-468f-a783-0389ba232a56 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:03.846313 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3e619d8c-2ad7-468f-a783-0389ba232a56 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:03.846313 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3e619d8c-2ad7-468f-a783-0389ba232a56 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:03.846313 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3e619d8c-2ad7-468f-a783-0389ba232a56 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:03.861052 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-49f266f4-598c-417b-96d6-bd8a21cd77c4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:03.870837 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-49f266f4-598c-417b-96d6-bd8a21cd77c4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.158881 Sep 23 15:21:03.871649 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 91/166] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:03 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:03.892685 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-30821d97-c6f3-4cb7-b092-8d2cf1046c3a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:03.898919 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-30821d97-c6f3-4cb7-b092-8d2cf1046c3a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:03.899356 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-30821d97-c6f3-4cb7-b092-8d2cf1046c3a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:03.899952 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-30821d97-c6f3-4cb7-b092-8d2cf1046c3a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:03.900752 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-30821d97-c6f3-4cb7-b092-8d2cf1046c3a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:03.901469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-30821d97-c6f3-4cb7-b092-8d2cf1046c3a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:03.901922 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-30821d97-c6f3-4cb7-b092-8d2cf1046c3a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:03.902345 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-30821d97-c6f3-4cb7-b092-8d2cf1046c3a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:03.982399 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-3e619d8c-2ad7-468f-a783-0389ba232a56 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:03.990068 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-3e619d8c-2ad7-468f-a783-0389ba232a56 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1363 microversion: 2.1 time: 0.168424 Sep 23 15:21:04.001124 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 76/167] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:03 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:21:04.038935 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-30821d97-c6f3-4cb7-b092-8d2cf1046c3a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:04.048695 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-30821d97-c6f3-4cb7-b092-8d2cf1046c3a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1314 microversion: 2.1 time: 0.159977 Sep 23 15:21:04.049401 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 92/168] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:03 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:04.323618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-3ee88a89-61d8-4b1a-bea5-ca71ab2c2240 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:04.324258 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-3ee88a89-61d8-4b1a-bea5-ca71ab2c2240 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:04.332058 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3ee88a89-61d8-4b1a-bea5-ca71ab2c2240 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:04.336241 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3ee88a89-61d8-4b1a-bea5-ca71ab2c2240 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:04.336964 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3ee88a89-61d8-4b1a-bea5-ca71ab2c2240 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:04.338588 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3ee88a89-61d8-4b1a-bea5-ca71ab2c2240 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:04.339049 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3ee88a89-61d8-4b1a-bea5-ca71ab2c2240 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:04.344229 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3ee88a89-61d8-4b1a-bea5-ca71ab2c2240 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:04.479154 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-3ee88a89-61d8-4b1a-bea5-ca71ab2c2240 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:04.487803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-3ee88a89-61d8-4b1a-bea5-ca71ab2c2240 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:04.489290 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-3ee88a89-61d8-4b1a-bea5-ca71ab2c2240 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:04.490442 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-3ee88a89-61d8-4b1a-bea5-ca71ab2c2240 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1408 microversion: 2.20 time: 0.171431 Sep 23 15:21:04.490992 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 77/169] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:21:04 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:21:04.895131 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-0d02880d-9d23-41b3-95a1-6a3acfbb0a60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:04.895673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-0d02880d-9d23-41b3-95a1-6a3acfbb0a60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:04.902097 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0d02880d-9d23-41b3-95a1-6a3acfbb0a60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:04.902591 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0d02880d-9d23-41b3-95a1-6a3acfbb0a60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:04.903022 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0d02880d-9d23-41b3-95a1-6a3acfbb0a60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:04.903708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0d02880d-9d23-41b3-95a1-6a3acfbb0a60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:04.904217 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0d02880d-9d23-41b3-95a1-6a3acfbb0a60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:04.904653 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0d02880d-9d23-41b3-95a1-6a3acfbb0a60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:05.016574 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-d51602bd-17dd-4b14-a9f8-4b09beef662d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:05.018169 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-d51602bd-17dd-4b14-a9f8-4b09beef662d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:05.033178 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d51602bd-17dd-4b14-a9f8-4b09beef662d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:05.033672 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d51602bd-17dd-4b14-a9f8-4b09beef662d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:05.034132 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d51602bd-17dd-4b14-a9f8-4b09beef662d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:05.035202 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d51602bd-17dd-4b14-a9f8-4b09beef662d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:05.035710 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d51602bd-17dd-4b14-a9f8-4b09beef662d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:05.036144 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d51602bd-17dd-4b14-a9f8-4b09beef662d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:05.094533 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-0d02880d-9d23-41b3-95a1-6a3acfbb0a60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:05.102837 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-0d02880d-9d23-41b3-95a1-6a3acfbb0a60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.211598 Sep 23 15:21:05.103415 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 93/170] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:04 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:05.110812 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-5d427afe-ea89-4c73-8e95-04cfb79a0e50 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:05.111832 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-5d427afe-ea89-4c73-8e95-04cfb79a0e50 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:05.124698 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5d427afe-ea89-4c73-8e95-04cfb79a0e50 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:05.125576 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5d427afe-ea89-4c73-8e95-04cfb79a0e50 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:05.126501 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5d427afe-ea89-4c73-8e95-04cfb79a0e50 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:05.127430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5d427afe-ea89-4c73-8e95-04cfb79a0e50 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:05.129401 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5d427afe-ea89-4c73-8e95-04cfb79a0e50 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:05.130222 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5d427afe-ea89-4c73-8e95-04cfb79a0e50 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:05.214372 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-d51602bd-17dd-4b14-a9f8-4b09beef662d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:05.225740 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-d51602bd-17dd-4b14-a9f8-4b09beef662d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1548 microversion: 2.1 time: 0.213509 Sep 23 15:21:05.229627 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 78/171] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:05 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1548 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:21:05.257308 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-bf70af72-6fc8-4ef3-a65f-811fd6130b3c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:05.257954 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-bf70af72-6fc8-4ef3-a65f-811fd6130b3c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:05.266760 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf70af72-6fc8-4ef3-a65f-811fd6130b3c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:05.267565 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf70af72-6fc8-4ef3-a65f-811fd6130b3c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:05.268044 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf70af72-6fc8-4ef3-a65f-811fd6130b3c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:05.268763 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf70af72-6fc8-4ef3-a65f-811fd6130b3c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:05.269218 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf70af72-6fc8-4ef3-a65f-811fd6130b3c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:05.269844 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf70af72-6fc8-4ef3-a65f-811fd6130b3c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:05.427936 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-bf70af72-6fc8-4ef3-a65f-811fd6130b3c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.171764 Sep 23 15:21:05.427936 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 79/172] 10.222.0.55 () {58 vars in 1275 bytes} [Fri Sep 23 15:21:05 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f/os-interface => generated 284 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:21:05.519272 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-587d9628-4884-46f0-9885-3b0aeeadefd3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:05.520166 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-587d9628-4884-46f0-9885-3b0aeeadefd3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:05.532317 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-587d9628-4884-46f0-9885-3b0aeeadefd3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:05.533496 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-587d9628-4884-46f0-9885-3b0aeeadefd3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:05.534390 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-587d9628-4884-46f0-9885-3b0aeeadefd3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:05.535317 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-587d9628-4884-46f0-9885-3b0aeeadefd3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:05.536580 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-587d9628-4884-46f0-9885-3b0aeeadefd3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:05.537860 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-587d9628-4884-46f0-9885-3b0aeeadefd3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:05.569775 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-5d427afe-ea89-4c73-8e95-04cfb79a0e50 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:05.583222 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-5d427afe-ea89-4c73-8e95-04cfb79a0e50 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1314 microversion: 2.1 time: 0.478544 Sep 23 15:21:05.588369 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 94/173] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:05 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:06.033791 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-587d9628-4884-46f0-9885-3b0aeeadefd3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:06.046219 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-587d9628-4884-46f0-9885-3b0aeeadefd3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:06.049697 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-587d9628-4884-46f0-9885-3b0aeeadefd3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:06.051192 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-587d9628-4884-46f0-9885-3b0aeeadefd3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1408 microversion: 2.20 time: 0.538260 Sep 23 15:21:06.053719 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 80/174] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:21:05 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1408 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:21:06.126850 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-e0659c11-06b4-4e7e-804a-9deb32d42970 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:06.127542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-e0659c11-06b4-4e7e-804a-9deb32d42970 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:06.134730 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e0659c11-06b4-4e7e-804a-9deb32d42970 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:06.135346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e0659c11-06b4-4e7e-804a-9deb32d42970 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:06.135851 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e0659c11-06b4-4e7e-804a-9deb32d42970 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:06.136693 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e0659c11-06b4-4e7e-804a-9deb32d42970 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:06.137218 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e0659c11-06b4-4e7e-804a-9deb32d42970 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:06.138085 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e0659c11-06b4-4e7e-804a-9deb32d42970 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:06.339506 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-e0659c11-06b4-4e7e-804a-9deb32d42970 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:06.347225 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-e0659c11-06b4-4e7e-804a-9deb32d42970 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.224761 Sep 23 15:21:06.347765 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 95/175] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:06 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:06.609896 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-3f449e3b-e0bf-4905-809a-526d2092b273 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:06.610505 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-3f449e3b-e0bf-4905-809a-526d2092b273 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:06.616592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3f449e3b-e0bf-4905-809a-526d2092b273 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:06.617008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3f449e3b-e0bf-4905-809a-526d2092b273 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:06.617444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3f449e3b-e0bf-4905-809a-526d2092b273 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:06.618134 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3f449e3b-e0bf-4905-809a-526d2092b273 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:06.618656 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3f449e3b-e0bf-4905-809a-526d2092b273 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:06.619086 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3f449e3b-e0bf-4905-809a-526d2092b273 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:06.889297 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-3f449e3b-e0bf-4905-809a-526d2092b273 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:06.899092 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-3f449e3b-e0bf-4905-809a-526d2092b273 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1314 microversion: 2.1 time: 0.293108 Sep 23 15:21:06.902027 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 81/176] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:06 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:07.078843 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-2b630eb2-5884-4a44-bc8f-2cc270801862 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:07.079448 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-2b630eb2-5884-4a44-bc8f-2cc270801862 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:07.093005 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2b630eb2-5884-4a44-bc8f-2cc270801862 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:07.096201 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2b630eb2-5884-4a44-bc8f-2cc270801862 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:07.099692 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2b630eb2-5884-4a44-bc8f-2cc270801862 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:07.103537 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2b630eb2-5884-4a44-bc8f-2cc270801862 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:07.105578 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2b630eb2-5884-4a44-bc8f-2cc270801862 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:07.106836 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2b630eb2-5884-4a44-bc8f-2cc270801862 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:07.114848 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:21:07.354890 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-2b630eb2-5884-4a44-bc8f-2cc270801862 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:07.363411 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-2b630eb2-5884-4a44-bc8f-2cc270801862 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:07.367206 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-228a97b8-ba4f-46c8-9b4e-3567caf5bd39 req-28fb1cfe-0037-4153-9bd7-583fa31203ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c5523ab-9085-47cd-9133-f65554b59f0f", "tag": "55424de1-677b-4c57-a21b-d9eb905f5fc7"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:21:07.369542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-2b630eb2-5884-4a44-bc8f-2cc270801862 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:07.370738 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-2b630eb2-5884-4a44-bc8f-2cc270801862 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1600 microversion: 2.20 time: 0.296170 Sep 23 15:21:07.371598 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 96/177] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:21:07 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1600 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:21:07.381931 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-228a97b8-ba4f-46c8-9b4e-3567caf5bd39 req-28fb1cfe-0037-4153-9bd7-583fa31203ca service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:07.394204 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-228a97b8-ba4f-46c8-9b4e-3567caf5bd39 req-28fb1cfe-0037-4153-9bd7-583fa31203ca service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:07.394204 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-228a97b8-ba4f-46c8-9b4e-3567caf5bd39 req-28fb1cfe-0037-4153-9bd7-583fa31203ca service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:07.394411 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-c29b9a29-b482-4278-a247-ce8125fe4052 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:07.394411 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-c29b9a29-b482-4278-a247-ce8125fe4052 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:07.397783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-228a97b8-ba4f-46c8-9b4e-3567caf5bd39 req-28fb1cfe-0037-4153-9bd7-583fa31203ca service nova] Creating event network-changed:55424de1-677b-4c57-a21b-d9eb905f5fc7 for instance 1c5523ab-9085-47cd-9133-f65554b59f0f on hv-cinder-85530 Sep 23 15:21:07.402443 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c29b9a29-b482-4278-a247-ce8125fe4052 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:07.404303 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-228a97b8-ba4f-46c8-9b4e-3567caf5bd39 req-28fb1cfe-0037-4153-9bd7-583fa31203ca service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043285 Sep 23 15:21:07.404449 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c29b9a29-b482-4278-a247-ce8125fe4052 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:07.404755 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c29b9a29-b482-4278-a247-ce8125fe4052 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:07.405477 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c29b9a29-b482-4278-a247-ce8125fe4052 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:07.405910 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c29b9a29-b482-4278-a247-ce8125fe4052 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:07.406499 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 82/178] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:21:07.407914 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c29b9a29-b482-4278-a247-ce8125fe4052 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:07.414032 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-b5321e21-4d62-4453-9be4-b9eed68c1cc7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:07.416467 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-b5321e21-4d62-4453-9be4-b9eed68c1cc7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:07.423996 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b5321e21-4d62-4453-9be4-b9eed68c1cc7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:07.424845 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b5321e21-4d62-4453-9be4-b9eed68c1cc7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:07.425501 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b5321e21-4d62-4453-9be4-b9eed68c1cc7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:07.426718 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b5321e21-4d62-4453-9be4-b9eed68c1cc7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:07.428119 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b5321e21-4d62-4453-9be4-b9eed68c1cc7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:07.428854 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b5321e21-4d62-4453-9be4-b9eed68c1cc7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:07.536876 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-b5321e21-4d62-4453-9be4-b9eed68c1cc7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.127848 Sep 23 15:21:07.537807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 83/179] 10.222.0.55 () {60 vars in 1316 bytes} [Fri Sep 23 15:21:07 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca/os-interface => generated 285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:21:07.591457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-c29b9a29-b482-4278-a247-ce8125fe4052 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:07.599954 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-c29b9a29-b482-4278-a247-ce8125fe4052 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.227313 Sep 23 15:21:07.600937 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 97/180] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:07 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:07.930226 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-055b88ca-006c-4b8a-a7f5-6e7945729a8c tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:07.931560 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-055b88ca-006c-4b8a-a7f5-6e7945729a8c tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:07.937824 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-055b88ca-006c-4b8a-a7f5-6e7945729a8c tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:07.944791 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-055b88ca-006c-4b8a-a7f5-6e7945729a8c tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:07.945381 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-055b88ca-006c-4b8a-a7f5-6e7945729a8c tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:07.946406 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-055b88ca-006c-4b8a-a7f5-6e7945729a8c tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:07.947759 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-055b88ca-006c-4b8a-a7f5-6e7945729a8c tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:07.948507 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-055b88ca-006c-4b8a-a7f5-6e7945729a8c tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:08.463433 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-055b88ca-006c-4b8a-a7f5-6e7945729a8c tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:08.475795 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-055b88ca-006c-4b8a-a7f5-6e7945729a8c tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1500 microversion: 2.1 time: 0.549545 Sep 23 15:21:08.478864 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 84/181] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:07 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1500 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:08.634820 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-0f250587-24bc-443e-9fc5-4461b9b2d73b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:08.635393 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-0f250587-24bc-443e-9fc5-4461b9b2d73b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:08.643240 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0f250587-24bc-443e-9fc5-4461b9b2d73b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:08.644101 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0f250587-24bc-443e-9fc5-4461b9b2d73b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:08.645015 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0f250587-24bc-443e-9fc5-4461b9b2d73b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:08.646083 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0f250587-24bc-443e-9fc5-4461b9b2d73b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:08.646825 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0f250587-24bc-443e-9fc5-4461b9b2d73b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:08.647468 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0f250587-24bc-443e-9fc5-4461b9b2d73b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:09.134126 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-0f250587-24bc-443e-9fc5-4461b9b2d73b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:09.146653 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-0f250587-24bc-443e-9fc5-4461b9b2d73b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.515990 Sep 23 15:21:09.150583 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 98/182] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:08 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:09.461786 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-c69b3671-d1e9-4776-b301-1d2ac0cc2d14 req-eb4f558b-b62d-4217-9025-b2c1a250035b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bba6fdd-bec4-491e-81ba-f3a9863f72ca", "tag": "8801bad0-f531-42e9-8015-b0d63a8e4f8e"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:21:09.474721 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-c69b3671-d1e9-4776-b301-1d2ac0cc2d14 req-eb4f558b-b62d-4217-9025-b2c1a250035b service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:09.475370 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-c69b3671-d1e9-4776-b301-1d2ac0cc2d14 req-eb4f558b-b62d-4217-9025-b2c1a250035b service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:09.476185 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-c69b3671-d1e9-4776-b301-1d2ac0cc2d14 req-eb4f558b-b62d-4217-9025-b2c1a250035b service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:09.490583 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-c69b3671-d1e9-4776-b301-1d2ac0cc2d14 req-eb4f558b-b62d-4217-9025-b2c1a250035b service nova] Creating event network-changed:8801bad0-f531-42e9-8015-b0d63a8e4f8e for instance 4bba6fdd-bec4-491e-81ba-f3a9863f72ca on hv-cinder-85530 Sep 23 15:21:09.508466 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-c69b3671-d1e9-4776-b301-1d2ac0cc2d14 req-eb4f558b-b62d-4217-9025-b2c1a250035b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043721 Sep 23 15:21:09.508466 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 85/183] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:21:10.177345 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-1a37cc78-7b17-483b-80d8-278b1832eae0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:10.177947 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-1a37cc78-7b17-483b-80d8-278b1832eae0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:10.187466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1a37cc78-7b17-483b-80d8-278b1832eae0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:10.187955 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1a37cc78-7b17-483b-80d8-278b1832eae0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:10.190616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1a37cc78-7b17-483b-80d8-278b1832eae0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:10.191337 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1a37cc78-7b17-483b-80d8-278b1832eae0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:10.193587 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1a37cc78-7b17-483b-80d8-278b1832eae0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:10.195490 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1a37cc78-7b17-483b-80d8-278b1832eae0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:10.471624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-1a37cc78-7b17-483b-80d8-278b1832eae0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:10.480452 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-1a37cc78-7b17-483b-80d8-278b1832eae0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.307472 Sep 23 15:21:10.481976 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 99/184] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:10 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:11.504602 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-527147c0-6132-4b1c-b6a2-4ffe6e0325d8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:11.505308 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-527147c0-6132-4b1c-b6a2-4ffe6e0325d8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:11.512303 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-527147c0-6132-4b1c-b6a2-4ffe6e0325d8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:11.512806 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-527147c0-6132-4b1c-b6a2-4ffe6e0325d8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:11.513562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-527147c0-6132-4b1c-b6a2-4ffe6e0325d8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:11.514182 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-527147c0-6132-4b1c-b6a2-4ffe6e0325d8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:11.514693 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-527147c0-6132-4b1c-b6a2-4ffe6e0325d8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:11.515093 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-527147c0-6132-4b1c-b6a2-4ffe6e0325d8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:11.651231 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-527147c0-6132-4b1c-b6a2-4ffe6e0325d8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:11.653924 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-527147c0-6132-4b1c-b6a2-4ffe6e0325d8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.153507 Sep 23 15:21:11.654834 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 86/185] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:11 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:11.922263 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-8c3ad0a6-1010-436c-9165-c0783fb9a89a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1567f0a-b403-41f3-b8c1-ae474200d7ef"}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:21:11.924705 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-8c3ad0a6-1010-436c-9165-c0783fb9a89a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:11.931848 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c3ad0a6-1010-436c-9165-c0783fb9a89a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:11.932427 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c3ad0a6-1010-436c-9165-c0783fb9a89a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:11.932895 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c3ad0a6-1010-436c-9165-c0783fb9a89a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:11.933568 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c3ad0a6-1010-436c-9165-c0783fb9a89a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:11.934023 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c3ad0a6-1010-436c-9165-c0783fb9a89a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:11.934449 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c3ad0a6-1010-436c-9165-c0783fb9a89a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:12.678030 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-481750e3-6c7d-481e-bd56-909b3772bc85 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:12.678628 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-481750e3-6c7d-481e-bd56-909b3772bc85 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:12.686063 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-481750e3-6c7d-481e-bd56-909b3772bc85 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:12.686547 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-481750e3-6c7d-481e-bd56-909b3772bc85 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:12.686992 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-481750e3-6c7d-481e-bd56-909b3772bc85 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:12.687690 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-481750e3-6c7d-481e-bd56-909b3772bc85 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:12.688338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-481750e3-6c7d-481e-bd56-909b3772bc85 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:12.688618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-481750e3-6c7d-481e-bd56-909b3772bc85 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:12.830781 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-481750e3-6c7d-481e-bd56-909b3772bc85 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:12.834308 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=100 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:21:12.839385 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-481750e3-6c7d-481e-bd56-909b3772bc85 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.165196 Sep 23 15:21:12.839955 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 87/186] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:12 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:21:13.301666 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-8c3ad0a6-1010-436c-9165-c0783fb9a89a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "POST /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.382926 Sep 23 15:21:13.302594 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 100/187] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Sep 23 15:21:11 2022] POST /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422/os-volume_attachments => generated 194 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:21:13.869741 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-28eb2176-4e02-4efa-894d-d16f7dd0f5f9 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:13.870964 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-28eb2176-4e02-4efa-894d-d16f7dd0f5f9 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:13.877532 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-28eb2176-4e02-4efa-894d-d16f7dd0f5f9 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:13.878246 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-28eb2176-4e02-4efa-894d-d16f7dd0f5f9 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:13.878680 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-28eb2176-4e02-4efa-894d-d16f7dd0f5f9 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:13.879588 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-28eb2176-4e02-4efa-894d-d16f7dd0f5f9 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:13.880078 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-28eb2176-4e02-4efa-894d-d16f7dd0f5f9 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:13.880702 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-28eb2176-4e02-4efa-894d-d16f7dd0f5f9 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:14.035792 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-28eb2176-4e02-4efa-894d-d16f7dd0f5f9 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:14.044149 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-28eb2176-4e02-4efa-894d-d16f7dd0f5f9 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.184565 Sep 23 15:21:14.044726 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 88/188] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:13 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:15.070029 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-68b93761-6919-42bc-a342-2cea5efb6a6b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:15.071559 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-68b93761-6919-42bc-a342-2cea5efb6a6b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:15.077477 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_api:SELECT=100 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:21:15.081907 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-68b93761-6919-42bc-a342-2cea5efb6a6b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:15.082405 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-68b93761-6919-42bc-a342-2cea5efb6a6b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:15.082910 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-68b93761-6919-42bc-a342-2cea5efb6a6b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:15.083599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-68b93761-6919-42bc-a342-2cea5efb6a6b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:15.084094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-68b93761-6919-42bc-a342-2cea5efb6a6b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:15.089106 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-68b93761-6919-42bc-a342-2cea5efb6a6b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:15.251861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-68b93761-6919-42bc-a342-2cea5efb6a6b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:15.266269 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-68b93761-6919-42bc-a342-2cea5efb6a6b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.201574 Sep 23 15:21:15.267368 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 101/189] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:15 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:16.291219 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-3c5cdcf9-afd7-4f2e-9887-7f4955ba31d3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:16.292593 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-3c5cdcf9-afd7-4f2e-9887-7f4955ba31d3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:16.299615 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3c5cdcf9-afd7-4f2e-9887-7f4955ba31d3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:16.300139 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3c5cdcf9-afd7-4f2e-9887-7f4955ba31d3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:16.300583 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3c5cdcf9-afd7-4f2e-9887-7f4955ba31d3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:16.301289 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3c5cdcf9-afd7-4f2e-9887-7f4955ba31d3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:16.301746 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3c5cdcf9-afd7-4f2e-9887-7f4955ba31d3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:16.302234 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3c5cdcf9-afd7-4f2e-9887-7f4955ba31d3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:16.464722 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-3c5cdcf9-afd7-4f2e-9887-7f4955ba31d3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:16.475456 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-3c5cdcf9-afd7-4f2e-9887-7f4955ba31d3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.188537 Sep 23 15:21:16.476048 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 89/190] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:16 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:17.498624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-ff82fc02-76bd-46e9-be65-8ed21392be3e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:17.499366 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-ff82fc02-76bd-46e9-be65-8ed21392be3e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:17.506169 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ff82fc02-76bd-46e9-be65-8ed21392be3e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:17.506654 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ff82fc02-76bd-46e9-be65-8ed21392be3e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:17.507094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ff82fc02-76bd-46e9-be65-8ed21392be3e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:17.507787 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ff82fc02-76bd-46e9-be65-8ed21392be3e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:17.508487 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ff82fc02-76bd-46e9-be65-8ed21392be3e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:17.508905 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ff82fc02-76bd-46e9-be65-8ed21392be3e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:17.658811 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-ff82fc02-76bd-46e9-be65-8ed21392be3e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:17.667386 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-ff82fc02-76bd-46e9-be65-8ed21392be3e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.172528 Sep 23 15:21:17.668166 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 102/191] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:17 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:18.690819 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-41858e5e-52f5-4ac2-87c8-946e246f8b84 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:18.692658 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-41858e5e-52f5-4ac2-87c8-946e246f8b84 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:18.699154 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-41858e5e-52f5-4ac2-87c8-946e246f8b84 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:18.701770 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-41858e5e-52f5-4ac2-87c8-946e246f8b84 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:18.701770 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-41858e5e-52f5-4ac2-87c8-946e246f8b84 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:18.701770 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-41858e5e-52f5-4ac2-87c8-946e246f8b84 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:18.701770 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-41858e5e-52f5-4ac2-87c8-946e246f8b84 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:18.702212 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-41858e5e-52f5-4ac2-87c8-946e246f8b84 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:18.850308 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-41858e5e-52f5-4ac2-87c8-946e246f8b84 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:18.859497 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-41858e5e-52f5-4ac2-87c8-946e246f8b84 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.172397 Sep 23 15:21:18.860289 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 90/192] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:18 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:19.882626 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a3d662ca-949f-4e8d-a2c8-8ab119de4678 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:19.883931 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-a3d662ca-949f-4e8d-a2c8-8ab119de4678 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:19.890911 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a3d662ca-949f-4e8d-a2c8-8ab119de4678 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:19.891399 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a3d662ca-949f-4e8d-a2c8-8ab119de4678 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:19.893006 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a3d662ca-949f-4e8d-a2c8-8ab119de4678 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:19.893006 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a3d662ca-949f-4e8d-a2c8-8ab119de4678 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:19.893006 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a3d662ca-949f-4e8d-a2c8-8ab119de4678 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:19.893456 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a3d662ca-949f-4e8d-a2c8-8ab119de4678 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:20.030026 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a3d662ca-949f-4e8d-a2c8-8ab119de4678 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:20.037990 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-a3d662ca-949f-4e8d-a2c8-8ab119de4678 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.159182 Sep 23 15:21:20.038552 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 103/193] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:19 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:21:21.061252 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-d70ee84c-3198-466f-9721-6adf9daaa91f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:21.062992 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-d70ee84c-3198-466f-9721-6adf9daaa91f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:21.069689 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d70ee84c-3198-466f-9721-6adf9daaa91f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:21.070194 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d70ee84c-3198-466f-9721-6adf9daaa91f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:21.071031 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d70ee84c-3198-466f-9721-6adf9daaa91f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:21.071739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d70ee84c-3198-466f-9721-6adf9daaa91f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:21.072211 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d70ee84c-3198-466f-9721-6adf9daaa91f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:21.072635 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d70ee84c-3198-466f-9721-6adf9daaa91f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:21.210644 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-d70ee84c-3198-466f-9721-6adf9daaa91f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:21.219252 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-d70ee84c-3198-466f-9721-6adf9daaa91f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.162257 Sep 23 15:21:21.234003 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 91/194] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:21 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:22.243299 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-526dbdcc-6a78-4740-a2fc-6552d1e36974 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:22.245217 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-526dbdcc-6a78-4740-a2fc-6552d1e36974 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:22.254312 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-526dbdcc-6a78-4740-a2fc-6552d1e36974 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:22.254875 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-526dbdcc-6a78-4740-a2fc-6552d1e36974 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:22.255435 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-526dbdcc-6a78-4740-a2fc-6552d1e36974 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:22.256744 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-526dbdcc-6a78-4740-a2fc-6552d1e36974 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:22.257220 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-526dbdcc-6a78-4740-a2fc-6552d1e36974 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:22.257645 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-526dbdcc-6a78-4740-a2fc-6552d1e36974 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:22.417948 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-526dbdcc-6a78-4740-a2fc-6552d1e36974 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:22.425752 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-526dbdcc-6a78-4740-a2fc-6552d1e36974 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.186906 Sep 23 15:21:22.426329 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 104/195] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:22 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:23.449035 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-c367d048-3e12-4b5c-b70a-4db2d6d253d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:23.449663 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-c367d048-3e12-4b5c-b70a-4db2d6d253d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:23.455718 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c367d048-3e12-4b5c-b70a-4db2d6d253d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:23.456243 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c367d048-3e12-4b5c-b70a-4db2d6d253d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:23.456738 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c367d048-3e12-4b5c-b70a-4db2d6d253d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:23.457703 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c367d048-3e12-4b5c-b70a-4db2d6d253d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:23.457822 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c367d048-3e12-4b5c-b70a-4db2d6d253d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:23.463528 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c367d048-3e12-4b5c-b70a-4db2d6d253d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:23.590371 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-c367d048-3e12-4b5c-b70a-4db2d6d253d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:23.598268 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-c367d048-3e12-4b5c-b70a-4db2d6d253d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.153327 Sep 23 15:21:23.598837 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 92/196] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:23 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:24.621649 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-6eeb9e23-d186-4843-bdd8-93021fe8e2f0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:24.622250 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-6eeb9e23-d186-4843-bdd8-93021fe8e2f0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:24.636705 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6eeb9e23-d186-4843-bdd8-93021fe8e2f0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:24.637451 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6eeb9e23-d186-4843-bdd8-93021fe8e2f0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:24.637882 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6eeb9e23-d186-4843-bdd8-93021fe8e2f0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:24.638576 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6eeb9e23-d186-4843-bdd8-93021fe8e2f0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:24.639026 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6eeb9e23-d186-4843-bdd8-93021fe8e2f0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:24.639445 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6eeb9e23-d186-4843-bdd8-93021fe8e2f0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:24.771540 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-6eeb9e23-d186-4843-bdd8-93021fe8e2f0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:24.778002 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-6eeb9e23-d186-4843-bdd8-93021fe8e2f0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.160610 Sep 23 15:21:24.778615 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 105/197] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:24 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:25.657791 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-580a2705-1430-4ba3-9b00-faba41f7eb08 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:25.658379 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-580a2705-1430-4ba3-9b00-faba41f7eb08 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:25.664188 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-580a2705-1430-4ba3-9b00-faba41f7eb08 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:25.664671 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-580a2705-1430-4ba3-9b00-faba41f7eb08 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:25.665111 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-580a2705-1430-4ba3-9b00-faba41f7eb08 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:25.666485 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-580a2705-1430-4ba3-9b00-faba41f7eb08 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:25.666957 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-580a2705-1430-4ba3-9b00-faba41f7eb08 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:25.667369 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-580a2705-1430-4ba3-9b00-faba41f7eb08 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:25.693917 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-580a2705-1430-4ba3-9b00-faba41f7eb08 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Going to try to terminate instance {{(pid=121448) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:21:25.802649 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-766f5edf-2279-4c4f-a387-8b8d5a7b8041 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:25.803199 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-766f5edf-2279-4c4f-a387-8b8d5a7b8041 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:25.810720 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-766f5edf-2279-4c4f-a387-8b8d5a7b8041 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:25.811340 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-766f5edf-2279-4c4f-a387-8b8d5a7b8041 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:25.811860 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-766f5edf-2279-4c4f-a387-8b8d5a7b8041 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:25.812664 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-766f5edf-2279-4c4f-a387-8b8d5a7b8041 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:25.813119 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-766f5edf-2279-4c4f-a387-8b8d5a7b8041 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:25.813541 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-766f5edf-2279-4c4f-a387-8b8d5a7b8041 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:25.959403 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-766f5edf-2279-4c4f-a387-8b8d5a7b8041 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:25.969231 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-766f5edf-2279-4c4f-a387-8b8d5a7b8041 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.170919 Sep 23 15:21:25.969821 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 106/198] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:25 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:21:26.246399 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-580a2705-1430-4ba3-9b00-faba41f7eb08 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "DELETE /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 204 len: 0 microversion: 2.1 time: 0.592436 Sep 23 15:21:26.247551 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 93/199] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Sep 23 15:21:25 2022] DELETE /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:21:26.255812 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-bf399f50-027e-4731-8c0c-d49fa38d5b08 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:26.256583 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-bf399f50-027e-4731-8c0c-d49fa38d5b08 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:26.263484 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bf399f50-027e-4731-8c0c-d49fa38d5b08 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:26.263990 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bf399f50-027e-4731-8c0c-d49fa38d5b08 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:26.264432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bf399f50-027e-4731-8c0c-d49fa38d5b08 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:26.265122 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bf399f50-027e-4731-8c0c-d49fa38d5b08 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:26.265577 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bf399f50-027e-4731-8c0c-d49fa38d5b08 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:26.265996 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bf399f50-027e-4731-8c0c-d49fa38d5b08 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:26.422411 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-bf399f50-027e-4731-8c0c-d49fa38d5b08 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:26.435524 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-bf399f50-027e-4731-8c0c-d49fa38d5b08 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1552 microversion: 2.1 time: 0.183489 Sep 23 15:21:26.436455 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 107/200] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:26 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1552 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:26.995162 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-ec90c126-4643-463d-a48b-dcc415e337c3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:26.996105 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-ec90c126-4643-463d-a48b-dcc415e337c3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:27.002015 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ec90c126-4643-463d-a48b-dcc415e337c3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:27.002488 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ec90c126-4643-463d-a48b-dcc415e337c3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:27.003002 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ec90c126-4643-463d-a48b-dcc415e337c3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:27.003597 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ec90c126-4643-463d-a48b-dcc415e337c3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:27.004069 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ec90c126-4643-463d-a48b-dcc415e337c3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:27.004653 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ec90c126-4643-463d-a48b-dcc415e337c3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:27.141130 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-ec90c126-4643-463d-a48b-dcc415e337c3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:27.148900 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-ec90c126-4643-463d-a48b-dcc415e337c3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.159225 Sep 23 15:21:27.149393 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 94/201] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:26 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:21:27.479140 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-f47aeddf-5b15-4f4b-bc2b-d006529d4808 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:27.480035 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-f47aeddf-5b15-4f4b-bc2b-d006529d4808 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:27.487129 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f47aeddf-5b15-4f4b-bc2b-d006529d4808 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:27.487797 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f47aeddf-5b15-4f4b-bc2b-d006529d4808 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:27.488461 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f47aeddf-5b15-4f4b-bc2b-d006529d4808 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:27.493586 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f47aeddf-5b15-4f4b-bc2b-d006529d4808 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:27.493586 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f47aeddf-5b15-4f4b-bc2b-d006529d4808 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:27.493586 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f47aeddf-5b15-4f4b-bc2b-d006529d4808 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:27.637617 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-f47aeddf-5b15-4f4b-bc2b-d006529d4808 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:27.646195 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-f47aeddf-5b15-4f4b-bc2b-d006529d4808 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1552 microversion: 2.1 time: 0.171288 Sep 23 15:21:27.646760 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 108/202] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:27 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1552 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:28.176204 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-52e0a170-8331-4716-b387-c6c5d13120f1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:28.186829 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-52e0a170-8331-4716-b387-c6c5d13120f1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:28.195547 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-52e0a170-8331-4716-b387-c6c5d13120f1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:28.200897 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-52e0a170-8331-4716-b387-c6c5d13120f1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:28.208905 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-52e0a170-8331-4716-b387-c6c5d13120f1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:28.208905 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-52e0a170-8331-4716-b387-c6c5d13120f1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:28.208905 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-52e0a170-8331-4716-b387-c6c5d13120f1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:28.208905 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-52e0a170-8331-4716-b387-c6c5d13120f1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:28.360226 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-52e0a170-8331-4716-b387-c6c5d13120f1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:28.367937 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-52e0a170-8331-4716-b387-c6c5d13120f1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.198790 Sep 23 15:21:28.368539 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 95/203] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:28 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:28.671528 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-e895c5f0-ee55-438b-9395-750b2dcd37b3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:28.672061 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-e895c5f0-ee55-438b-9395-750b2dcd37b3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:28.679093 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e895c5f0-ee55-438b-9395-750b2dcd37b3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:28.679613 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e895c5f0-ee55-438b-9395-750b2dcd37b3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:28.680228 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e895c5f0-ee55-438b-9395-750b2dcd37b3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:28.680955 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e895c5f0-ee55-438b-9395-750b2dcd37b3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:28.687721 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e895c5f0-ee55-438b-9395-750b2dcd37b3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:28.687721 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e895c5f0-ee55-438b-9395-750b2dcd37b3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:28.822066 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-e895c5f0-ee55-438b-9395-750b2dcd37b3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:28.831064 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-e895c5f0-ee55-438b-9395-750b2dcd37b3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1552 microversion: 2.1 time: 0.163299 Sep 23 15:21:28.831641 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 109/204] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:28 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:29.392731 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-94830951-8bc0-421f-90c1-d2c0f2e01eb9 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:29.393509 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-94830951-8bc0-421f-90c1-d2c0f2e01eb9 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:29.399541 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-94830951-8bc0-421f-90c1-d2c0f2e01eb9 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:29.400053 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-94830951-8bc0-421f-90c1-d2c0f2e01eb9 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:29.401009 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-94830951-8bc0-421f-90c1-d2c0f2e01eb9 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:29.401750 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-94830951-8bc0-421f-90c1-d2c0f2e01eb9 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:29.402211 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-94830951-8bc0-421f-90c1-d2c0f2e01eb9 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:29.402643 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-94830951-8bc0-421f-90c1-d2c0f2e01eb9 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:29.532500 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-94830951-8bc0-421f-90c1-d2c0f2e01eb9 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:29.540088 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-94830951-8bc0-421f-90c1-d2c0f2e01eb9 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.151530 Sep 23 15:21:29.540693 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 96/205] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:29 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:29.853555 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-f93ad3e1-ac66-4522-a6fc-1fb6360e5849 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:29.854285 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-f93ad3e1-ac66-4522-a6fc-1fb6360e5849 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:29.860753 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f93ad3e1-ac66-4522-a6fc-1fb6360e5849 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:29.861233 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f93ad3e1-ac66-4522-a6fc-1fb6360e5849 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:29.861703 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f93ad3e1-ac66-4522-a6fc-1fb6360e5849 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:29.862382 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f93ad3e1-ac66-4522-a6fc-1fb6360e5849 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:29.862828 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f93ad3e1-ac66-4522-a6fc-1fb6360e5849 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:29.863241 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f93ad3e1-ac66-4522-a6fc-1fb6360e5849 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:30.029433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-f93ad3e1-ac66-4522-a6fc-1fb6360e5849 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:30.037657 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-f93ad3e1-ac66-4522-a6fc-1fb6360e5849 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1552 microversion: 2.1 time: 0.187963 Sep 23 15:21:30.038218 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 110/206] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:29 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1552 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:30.564060 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-7beb30ea-553d-4dc5-b537-8648da45cd99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:30.564628 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-7beb30ea-553d-4dc5-b537-8648da45cd99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:30.570663 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7beb30ea-553d-4dc5-b537-8648da45cd99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:30.571151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7beb30ea-553d-4dc5-b537-8648da45cd99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:30.571591 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7beb30ea-553d-4dc5-b537-8648da45cd99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:30.572675 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7beb30ea-553d-4dc5-b537-8648da45cd99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:30.573568 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7beb30ea-553d-4dc5-b537-8648da45cd99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:30.574001 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7beb30ea-553d-4dc5-b537-8648da45cd99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:30.709811 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-7beb30ea-553d-4dc5-b537-8648da45cd99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:30.718344 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-7beb30ea-553d-4dc5-b537-8648da45cd99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.158287 Sep 23 15:21:30.718938 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 97/207] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:30 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:30.738582 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-78d0c620-8d3a-41b2-8583-48740d28f582 req-49796786-17e2-4988-951e-a4f29aa817bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "878c924c-fcc8-4dbf-8ea1-132f142e0422", "name": "network-vif-unplugged", "status": "completed", "tag": "fdb860b5-e215-4e14-8b93-274f42416008"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:21:30.752894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-78d0c620-8d3a-41b2-8583-48740d28f582 req-49796786-17e2-4988-951e-a4f29aa817bf service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:30.753330 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-78d0c620-8d3a-41b2-8583-48740d28f582 req-49796786-17e2-4988-951e-a4f29aa817bf service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:30.764036 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-78d0c620-8d3a-41b2-8583-48740d28f582 req-49796786-17e2-4988-951e-a4f29aa817bf service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:30.768868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-78d0c620-8d3a-41b2-8583-48740d28f582 req-49796786-17e2-4988-951e-a4f29aa817bf service nova] Creating event network-vif-unplugged:fdb860b5-e215-4e14-8b93-274f42416008 for instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 on hv-cinder-85530 Sep 23 15:21:30.771270 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-78d0c620-8d3a-41b2-8583-48740d28f582 req-49796786-17e2-4988-951e-a4f29aa817bf service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036596 Sep 23 15:21:30.771929 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 111/208] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:21:31.074550 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-37612beb-8982-456e-8738-af6d2cc43877 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:31.075465 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-37612beb-8982-456e-8738-af6d2cc43877 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:31.082045 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-37612beb-8982-456e-8738-af6d2cc43877 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:31.082765 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-37612beb-8982-456e-8738-af6d2cc43877 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:31.083439 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-37612beb-8982-456e-8738-af6d2cc43877 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:31.085017 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-37612beb-8982-456e-8738-af6d2cc43877 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:31.085483 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-37612beb-8982-456e-8738-af6d2cc43877 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:31.085959 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-37612beb-8982-456e-8738-af6d2cc43877 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:31.220919 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-37612beb-8982-456e-8738-af6d2cc43877 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:31.229875 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-37612beb-8982-456e-8738-af6d2cc43877 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1552 microversion: 2.1 time: 0.173356 Sep 23 15:21:31.230480 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 98/209] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:31 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1552 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:31.743355 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-8131530b-d2c2-4ceb-be23-1579210eebc3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:31.744099 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-8131530b-d2c2-4ceb-be23-1579210eebc3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:31.750917 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8131530b-d2c2-4ceb-be23-1579210eebc3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:31.751389 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8131530b-d2c2-4ceb-be23-1579210eebc3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:31.751818 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8131530b-d2c2-4ceb-be23-1579210eebc3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:31.752602 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8131530b-d2c2-4ceb-be23-1579210eebc3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:31.753048 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8131530b-d2c2-4ceb-be23-1579210eebc3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:31.753463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8131530b-d2c2-4ceb-be23-1579210eebc3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:31.757531 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:21:31.885922 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-8131530b-d2c2-4ceb-be23-1579210eebc3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:31.894178 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-8131530b-d2c2-4ceb-be23-1579210eebc3 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.155570 Sep 23 15:21:31.894787 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 112/210] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:31 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:32.253452 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-26743d21-3771-444a-aad7-a4dfd5391049 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:32.254154 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-26743d21-3771-444a-aad7-a4dfd5391049 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:32.260820 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-26743d21-3771-444a-aad7-a4dfd5391049 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:32.261415 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-26743d21-3771-444a-aad7-a4dfd5391049 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:32.262114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-26743d21-3771-444a-aad7-a4dfd5391049 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:32.262841 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-26743d21-3771-444a-aad7-a4dfd5391049 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:32.263896 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-26743d21-3771-444a-aad7-a4dfd5391049 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:32.263896 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-26743d21-3771-444a-aad7-a4dfd5391049 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:32.400095 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-26743d21-3771-444a-aad7-a4dfd5391049 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:32.409490 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-26743d21-3771-444a-aad7-a4dfd5391049 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1552 microversion: 2.1 time: 0.159817 Sep 23 15:21:32.410140 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 99/211] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:32 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:32.837919 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-3386ed17-ab2d-44ad-994c-bd6934c30026 req-8d141691-5dfb-4d53-9d91-035a75ba02dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "878c924c-fcc8-4dbf-8ea1-132f142e0422", "name": "network-vif-deleted", "tag": "fdb860b5-e215-4e14-8b93-274f42416008"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:21:32.853035 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-3386ed17-ab2d-44ad-994c-bd6934c30026 req-8d141691-5dfb-4d53-9d91-035a75ba02dd service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:32.853550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-3386ed17-ab2d-44ad-994c-bd6934c30026 req-8d141691-5dfb-4d53-9d91-035a75ba02dd service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:32.853980 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-3386ed17-ab2d-44ad-994c-bd6934c30026 req-8d141691-5dfb-4d53-9d91-035a75ba02dd service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:32.866340 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-3386ed17-ab2d-44ad-994c-bd6934c30026 req-8d141691-5dfb-4d53-9d91-035a75ba02dd service nova] Creating event network-vif-deleted:fdb860b5-e215-4e14-8b93-274f42416008 for instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 on hv-cinder-85530 Sep 23 15:21:32.872377 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-3386ed17-ab2d-44ad-994c-bd6934c30026 req-8d141691-5dfb-4d53-9d91-035a75ba02dd service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052568 Sep 23 15:21:32.873010 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 113/212] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:21:32.919491 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-747812e9-13c3-404e-a4b1-faea504cd17c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:32.920183 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-747812e9-13c3-404e-a4b1-faea504cd17c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:32.923255 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:21:32.926951 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-747812e9-13c3-404e-a4b1-faea504cd17c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:32.927440 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-747812e9-13c3-404e-a4b1-faea504cd17c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:32.927882 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-747812e9-13c3-404e-a4b1-faea504cd17c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:32.928691 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-747812e9-13c3-404e-a4b1-faea504cd17c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:32.929159 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-747812e9-13c3-404e-a4b1-faea504cd17c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:32.929651 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-747812e9-13c3-404e-a4b1-faea504cd17c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:33.070864 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-747812e9-13c3-404e-a4b1-faea504cd17c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:33.082459 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-747812e9-13c3-404e-a4b1-faea504cd17c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.168326 Sep 23 15:21:33.083054 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 100/213] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:32 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:33.435033 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-4d663942-c138-4175-9979-c8738df99e38 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:33.435667 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-4d663942-c138-4175-9979-c8738df99e38 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:33.441989 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4d663942-c138-4175-9979-c8738df99e38 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:33.442469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4d663942-c138-4175-9979-c8738df99e38 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:33.442953 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4d663942-c138-4175-9979-c8738df99e38 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:33.443640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4d663942-c138-4175-9979-c8738df99e38 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:33.444118 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4d663942-c138-4175-9979-c8738df99e38 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:33.444547 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4d663942-c138-4175-9979-c8738df99e38 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:33.514213 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-4d663942-c138-4175-9979-c8738df99e38 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:33.532226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-4d663942-c138-4175-9979-c8738df99e38 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1345 microversion: 2.1 time: 0.101971 Sep 23 15:21:33.532963 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 114/214] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:33 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1345 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:34.108782 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-1d89de9b-2d73-4abb-8976-2532bd6d49c7 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:34.109413 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-1d89de9b-2d73-4abb-8976-2532bd6d49c7 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:34.121414 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1d89de9b-2d73-4abb-8976-2532bd6d49c7 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:34.121414 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1d89de9b-2d73-4abb-8976-2532bd6d49c7 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:34.121414 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1d89de9b-2d73-4abb-8976-2532bd6d49c7 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:34.121414 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1d89de9b-2d73-4abb-8976-2532bd6d49c7 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:34.121783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1d89de9b-2d73-4abb-8976-2532bd6d49c7 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:34.121783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1d89de9b-2d73-4abb-8976-2532bd6d49c7 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:34.267230 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-1d89de9b-2d73-4abb-8976-2532bd6d49c7 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:34.275007 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-1d89de9b-2d73-4abb-8976-2532bd6d49c7 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.170325 Sep 23 15:21:34.275635 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 101/215] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:34 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:34.556554 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-12307e62-c608-46c4-8ab6-3dcf08fc489a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:34.557312 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-12307e62-c608-46c4-8ab6-3dcf08fc489a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:34.563999 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-12307e62-c608-46c4-8ab6-3dcf08fc489a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:34.564492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-12307e62-c608-46c4-8ab6-3dcf08fc489a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:34.564922 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-12307e62-c608-46c4-8ab6-3dcf08fc489a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:34.565607 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-12307e62-c608-46c4-8ab6-3dcf08fc489a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:34.566057 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-12307e62-c608-46c4-8ab6-3dcf08fc489a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:34.566472 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-12307e62-c608-46c4-8ab6-3dcf08fc489a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:34.628214 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-12307e62-c608-46c4-8ab6-3dcf08fc489a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:34.637186 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-12307e62-c608-46c4-8ab6-3dcf08fc489a tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1345 microversion: 2.1 time: 0.084942 Sep 23 15:21:34.638232 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 115/216] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:34 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:35.299002 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-1821b9fa-2b7b-4332-b037-22167608c7da tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:35.299665 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-1821b9fa-2b7b-4332-b037-22167608c7da tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:35.306122 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1821b9fa-2b7b-4332-b037-22167608c7da tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:35.307533 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1821b9fa-2b7b-4332-b037-22167608c7da tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:35.307660 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1821b9fa-2b7b-4332-b037-22167608c7da tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:35.308478 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1821b9fa-2b7b-4332-b037-22167608c7da tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:35.308937 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1821b9fa-2b7b-4332-b037-22167608c7da tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:35.309362 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1821b9fa-2b7b-4332-b037-22167608c7da tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:35.442833 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-1821b9fa-2b7b-4332-b037-22167608c7da tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:35.446482 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:21:35.452071 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-1821b9fa-2b7b-4332-b037-22167608c7da tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.157309 Sep 23 15:21:35.452644 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 102/217] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:35 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:35.660573 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-812df2f5-fc97-4d96-9362-88a4b48e016d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:35.661080 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-812df2f5-fc97-4d96-9362-88a4b48e016d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:35.668859 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-812df2f5-fc97-4d96-9362-88a4b48e016d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:35.669335 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-812df2f5-fc97-4d96-9362-88a4b48e016d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:35.669765 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-812df2f5-fc97-4d96-9362-88a4b48e016d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:35.670441 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-812df2f5-fc97-4d96-9362-88a4b48e016d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:35.670889 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-812df2f5-fc97-4d96-9362-88a4b48e016d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:35.671308 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-812df2f5-fc97-4d96-9362-88a4b48e016d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:35.735382 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-812df2f5-fc97-4d96-9362-88a4b48e016d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:35.745018 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-812df2f5-fc97-4d96-9362-88a4b48e016d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1345 microversion: 2.1 time: 0.087665 Sep 23 15:21:35.745927 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 116/218] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:35 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:36.474692 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-9b41ceb9-f33d-4886-84b4-8fdec44e0b0d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:36.475307 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-9b41ceb9-f33d-4886-84b4-8fdec44e0b0d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:36.482967 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9b41ceb9-f33d-4886-84b4-8fdec44e0b0d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:36.483455 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9b41ceb9-f33d-4886-84b4-8fdec44e0b0d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:36.483894 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9b41ceb9-f33d-4886-84b4-8fdec44e0b0d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:36.484626 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9b41ceb9-f33d-4886-84b4-8fdec44e0b0d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:36.485116 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9b41ceb9-f33d-4886-84b4-8fdec44e0b0d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:36.485587 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9b41ceb9-f33d-4886-84b4-8fdec44e0b0d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:36.614734 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-9b41ceb9-f33d-4886-84b4-8fdec44e0b0d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:36.623867 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-9b41ceb9-f33d-4886-84b4-8fdec44e0b0d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1523 microversion: 2.1 time: 0.153081 Sep 23 15:21:36.624486 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 103/219] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:36 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:36.772048 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-49b84f6f-7cdc-4a0e-ae7c-f0f81cb2fcc3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:36.772653 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-49b84f6f-7cdc-4a0e-ae7c-f0f81cb2fcc3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:36.779963 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-49b84f6f-7cdc-4a0e-ae7c-f0f81cb2fcc3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:36.780466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-49b84f6f-7cdc-4a0e-ae7c-f0f81cb2fcc3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:36.780896 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-49b84f6f-7cdc-4a0e-ae7c-f0f81cb2fcc3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:36.781624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-49b84f6f-7cdc-4a0e-ae7c-f0f81cb2fcc3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:36.782067 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-49b84f6f-7cdc-4a0e-ae7c-f0f81cb2fcc3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:36.782512 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-49b84f6f-7cdc-4a0e-ae7c-f0f81cb2fcc3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:36.951431 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-49b84f6f-7cdc-4a0e-ae7c-f0f81cb2fcc3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:36.960712 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-49b84f6f-7cdc-4a0e-ae7c-f0f81cb2fcc3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1345 microversion: 2.1 time: 0.192186 Sep 23 15:21:36.961284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 117/220] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:36 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1345 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:37.648219 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-458bd6ed-0816-43aa-ba52-9ec9248a9140 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:37.648840 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-458bd6ed-0816-43aa-ba52-9ec9248a9140 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:37.655723 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-458bd6ed-0816-43aa-ba52-9ec9248a9140 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:37.656231 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-458bd6ed-0816-43aa-ba52-9ec9248a9140 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:37.656672 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-458bd6ed-0816-43aa-ba52-9ec9248a9140 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:37.657362 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-458bd6ed-0816-43aa-ba52-9ec9248a9140 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:37.657821 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-458bd6ed-0816-43aa-ba52-9ec9248a9140 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:37.658277 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-458bd6ed-0816-43aa-ba52-9ec9248a9140 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:37.790219 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-458bd6ed-0816-43aa-ba52-9ec9248a9140 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:37.798626 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-458bd6ed-0816-43aa-ba52-9ec9248a9140 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1503 microversion: 2.1 time: 0.154261 Sep 23 15:21:37.799195 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 104/221] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:37 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:37.821077 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-59b7048d-e545-4090-a631-26fded027e6a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:37.821684 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-59b7048d-e545-4090-a631-26fded027e6a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:37.828295 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-59b7048d-e545-4090-a631-26fded027e6a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:37.828774 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-59b7048d-e545-4090-a631-26fded027e6a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:37.829208 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-59b7048d-e545-4090-a631-26fded027e6a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:37.829906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-59b7048d-e545-4090-a631-26fded027e6a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:37.830335 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-59b7048d-e545-4090-a631-26fded027e6a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:37.830753 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-59b7048d-e545-4090-a631-26fded027e6a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:37.964227 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-59b7048d-e545-4090-a631-26fded027e6a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:37.972081 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-59b7048d-e545-4090-a631-26fded027e6a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 200 len: 1516 microversion: 2.1 time: 0.154719 Sep 23 15:21:37.972664 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 118/222] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:37 2022] GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:37.985749 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-f48c37bb-8042-42f6-8d2e-826f2105cdd1 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:37.986528 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-f48c37bb-8042-42f6-8d2e-826f2105cdd1 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:37.993133 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f48c37bb-8042-42f6-8d2e-826f2105cdd1 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:37.993936 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f48c37bb-8042-42f6-8d2e-826f2105cdd1 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:37.995230 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f48c37bb-8042-42f6-8d2e-826f2105cdd1 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:37.996415 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f48c37bb-8042-42f6-8d2e-826f2105cdd1 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:37.996882 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f48c37bb-8042-42f6-8d2e-826f2105cdd1 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:37.997312 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f48c37bb-8042-42f6-8d2e-826f2105cdd1 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:38.063300 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-f48c37bb-8042-42f6-8d2e-826f2105cdd1 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:38.071816 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-f48c37bb-8042-42f6-8d2e-826f2105cdd1 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1345 microversion: 2.1 time: 0.091017 Sep 23 15:21:38.073212 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 105/223] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:37 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1345 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:39.095528 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-c7c2c544-364c-425a-bf00-efff66596e16 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:39.096167 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-c7c2c544-364c-425a-bf00-efff66596e16 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:39.102562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c7c2c544-364c-425a-bf00-efff66596e16 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:39.103039 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c7c2c544-364c-425a-bf00-efff66596e16 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:39.103530 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c7c2c544-364c-425a-bf00-efff66596e16 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:39.104804 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c7c2c544-364c-425a-bf00-efff66596e16 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:39.105366 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c7c2c544-364c-425a-bf00-efff66596e16 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:39.105790 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c7c2c544-364c-425a-bf00-efff66596e16 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:39.165748 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-c7c2c544-364c-425a-bf00-efff66596e16 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:39.175295 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-c7c2c544-364c-425a-bf00-efff66596e16 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1345 microversion: 2.1 time: 0.083632 Sep 23 15:21:39.175864 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 119/224] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:39 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:40.198685 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6b4ca60f-ad4b-40ac-83b2-9c7a55d940f3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:40.199296 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-6b4ca60f-ad4b-40ac-83b2-9c7a55d940f3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:40.205305 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6b4ca60f-ad4b-40ac-83b2-9c7a55d940f3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:40.205795 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6b4ca60f-ad4b-40ac-83b2-9c7a55d940f3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:40.206242 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6b4ca60f-ad4b-40ac-83b2-9c7a55d940f3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:40.206927 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6b4ca60f-ad4b-40ac-83b2-9c7a55d940f3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:40.207567 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6b4ca60f-ad4b-40ac-83b2-9c7a55d940f3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:40.207810 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6b4ca60f-ad4b-40ac-83b2-9c7a55d940f3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:40.270252 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6b4ca60f-ad4b-40ac-83b2-9c7a55d940f3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:40.278916 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-6b4ca60f-ad4b-40ac-83b2-9c7a55d940f3 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1345 microversion: 2.1 time: 0.084272 Sep 23 15:21:40.279510 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 106/225] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:40 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:41.303061 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-1bfd3da7-ea90-4e37-9cb9-90806e51a61d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:41.304533 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-1bfd3da7-ea90-4e37-9cb9-90806e51a61d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:41.312034 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1bfd3da7-ea90-4e37-9cb9-90806e51a61d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:41.312559 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1bfd3da7-ea90-4e37-9cb9-90806e51a61d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:41.312990 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1bfd3da7-ea90-4e37-9cb9-90806e51a61d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:41.313678 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1bfd3da7-ea90-4e37-9cb9-90806e51a61d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:41.314124 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1bfd3da7-ea90-4e37-9cb9-90806e51a61d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:41.314578 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1bfd3da7-ea90-4e37-9cb9-90806e51a61d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:41.381396 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-1bfd3da7-ea90-4e37-9cb9-90806e51a61d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:41.393472 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-1bfd3da7-ea90-4e37-9cb9-90806e51a61d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1345 microversion: 2.1 time: 0.094500 Sep 23 15:21:41.394215 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 120/226] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:41 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1345 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:42.419076 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6980572b-aa6e-43d7-80ae-ce8a48dd9deb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:42.419642 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-6980572b-aa6e-43d7-80ae-ce8a48dd9deb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:42.425858 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6980572b-aa6e-43d7-80ae-ce8a48dd9deb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:42.426357 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6980572b-aa6e-43d7-80ae-ce8a48dd9deb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:42.426796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6980572b-aa6e-43d7-80ae-ce8a48dd9deb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:42.427487 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6980572b-aa6e-43d7-80ae-ce8a48dd9deb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:42.427994 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6980572b-aa6e-43d7-80ae-ce8a48dd9deb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:42.428456 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6980572b-aa6e-43d7-80ae-ce8a48dd9deb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:42.489493 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6980572b-aa6e-43d7-80ae-ce8a48dd9deb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:42.498209 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-6980572b-aa6e-43d7-80ae-ce8a48dd9deb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1345 microversion: 2.1 time: 0.083963 Sep 23 15:21:42.498768 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 107/227] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:42 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:43.520312 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-6b95e1e7-cf4e-402c-90ef-7f5e4353ed82 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:43.520944 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-6b95e1e7-cf4e-402c-90ef-7f5e4353ed82 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:43.528030 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6b95e1e7-cf4e-402c-90ef-7f5e4353ed82 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:43.528520 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6b95e1e7-cf4e-402c-90ef-7f5e4353ed82 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:43.528976 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6b95e1e7-cf4e-402c-90ef-7f5e4353ed82 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:43.529881 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6b95e1e7-cf4e-402c-90ef-7f5e4353ed82 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:43.530487 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6b95e1e7-cf4e-402c-90ef-7f5e4353ed82 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:43.530913 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6b95e1e7-cf4e-402c-90ef-7f5e4353ed82 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:43.593421 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-6b95e1e7-cf4e-402c-90ef-7f5e4353ed82 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:43.601759 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-6b95e1e7-cf4e-402c-90ef-7f5e4353ed82 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1345 microversion: 2.1 time: 0.085474 Sep 23 15:21:43.602330 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 121/228] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:43 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:44.626183 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-f023a6e6-5f8f-43b7-99dc-7f190bce24f7 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:44.626783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-f023a6e6-5f8f-43b7-99dc-7f190bce24f7 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:44.632914 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f023a6e6-5f8f-43b7-99dc-7f190bce24f7 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:44.633426 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f023a6e6-5f8f-43b7-99dc-7f190bce24f7 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:44.633858 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f023a6e6-5f8f-43b7-99dc-7f190bce24f7 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:44.634542 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f023a6e6-5f8f-43b7-99dc-7f190bce24f7 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:44.635165 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f023a6e6-5f8f-43b7-99dc-7f190bce24f7 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:44.635608 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f023a6e6-5f8f-43b7-99dc-7f190bce24f7 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:44.670509 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f023a6e6-5f8f-43b7-99dc-7f190bce24f7 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:44.670991 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f023a6e6-5f8f-43b7-99dc-7f190bce24f7 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:44.671501 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f023a6e6-5f8f-43b7-99dc-7f190bce24f7 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:44.672066 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.objects.instance [None req-f023a6e6-5f8f-43b7-99dc-7f190bce24f7 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lazy-loading 'fault' on Instance uuid 878c924c-fcc8-4dbf-8ea1-132f142e0422 {{(pid=121448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:21:44.721217 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-f023a6e6-5f8f-43b7-99dc-7f190bce24f7 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:44.729585 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-f023a6e6-5f8f-43b7-99dc-7f190bce24f7 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1350 microversion: 2.1 time: 0.107375 Sep 23 15:21:44.730761 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 108/229] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:44 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1350 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:45.753304 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-33da6d5d-bfe2-40c9-9da8-e5c8ca71ab8d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:45.753921 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-33da6d5d-bfe2-40c9-9da8-e5c8ca71ab8d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:45.761177 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-33da6d5d-bfe2-40c9-9da8-e5c8ca71ab8d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:45.762386 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-33da6d5d-bfe2-40c9-9da8-e5c8ca71ab8d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:45.762997 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-33da6d5d-bfe2-40c9-9da8-e5c8ca71ab8d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:45.763685 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-33da6d5d-bfe2-40c9-9da8-e5c8ca71ab8d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:45.764180 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-33da6d5d-bfe2-40c9-9da8-e5c8ca71ab8d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:45.764601 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-33da6d5d-bfe2-40c9-9da8-e5c8ca71ab8d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:45.797141 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-33da6d5d-bfe2-40c9-9da8-e5c8ca71ab8d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:45.797525 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-33da6d5d-bfe2-40c9-9da8-e5c8ca71ab8d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:45.797959 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-33da6d5d-bfe2-40c9-9da8-e5c8ca71ab8d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:45.798407 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.objects.instance [None req-33da6d5d-bfe2-40c9-9da8-e5c8ca71ab8d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lazy-loading 'fault' on Instance uuid 878c924c-fcc8-4dbf-8ea1-132f142e0422 {{(pid=121450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:21:45.842023 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-33da6d5d-bfe2-40c9-9da8-e5c8ca71ab8d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:45.849985 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-33da6d5d-bfe2-40c9-9da8-e5c8ca71ab8d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1350 microversion: 2.1 time: 0.100806 Sep 23 15:21:45.850548 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 122/230] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:45 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1350 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:46.873341 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-fe600b07-aee7-4679-b150-15e77a0c42fb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:46.873906 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-fe600b07-aee7-4679-b150-15e77a0c42fb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:46.879784 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fe600b07-aee7-4679-b150-15e77a0c42fb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:46.880299 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fe600b07-aee7-4679-b150-15e77a0c42fb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:46.880739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fe600b07-aee7-4679-b150-15e77a0c42fb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:46.881428 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fe600b07-aee7-4679-b150-15e77a0c42fb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:46.881878 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fe600b07-aee7-4679-b150-15e77a0c42fb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:46.882301 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fe600b07-aee7-4679-b150-15e77a0c42fb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:46.915202 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fe600b07-aee7-4679-b150-15e77a0c42fb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:46.915671 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fe600b07-aee7-4679-b150-15e77a0c42fb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:46.916216 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fe600b07-aee7-4679-b150-15e77a0c42fb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:46.916666 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.objects.instance [None req-fe600b07-aee7-4679-b150-15e77a0c42fb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lazy-loading 'fault' on Instance uuid 878c924c-fcc8-4dbf-8ea1-132f142e0422 {{(pid=121448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:21:46.957001 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-fe600b07-aee7-4679-b150-15e77a0c42fb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:46.965361 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-fe600b07-aee7-4679-b150-15e77a0c42fb tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1350 microversion: 2.1 time: 0.096013 Sep 23 15:21:46.965931 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 109/231] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:46 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:47.988482 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-e2955192-6c72-495e-85a2-e29dbaa77cba tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:47.989132 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-e2955192-6c72-495e-85a2-e29dbaa77cba tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:47.991645 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_api:SELECT=45 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:21:47.997131 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e2955192-6c72-495e-85a2-e29dbaa77cba tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:47.997599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e2955192-6c72-495e-85a2-e29dbaa77cba tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:47.998027 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e2955192-6c72-495e-85a2-e29dbaa77cba tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:47.998702 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e2955192-6c72-495e-85a2-e29dbaa77cba tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:47.999148 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e2955192-6c72-495e-85a2-e29dbaa77cba tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:47.999563 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e2955192-6c72-495e-85a2-e29dbaa77cba tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:48.031212 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e2955192-6c72-495e-85a2-e29dbaa77cba tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:48.031687 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e2955192-6c72-495e-85a2-e29dbaa77cba tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:48.032181 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e2955192-6c72-495e-85a2-e29dbaa77cba tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:48.032624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.objects.instance [None req-e2955192-6c72-495e-85a2-e29dbaa77cba tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lazy-loading 'fault' on Instance uuid 878c924c-fcc8-4dbf-8ea1-132f142e0422 {{(pid=121450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:21:48.072442 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-e2955192-6c72-495e-85a2-e29dbaa77cba tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:48.081629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-e2955192-6c72-495e-85a2-e29dbaa77cba tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1350 microversion: 2.1 time: 0.096854 Sep 23 15:21:48.082404 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 123/232] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:47 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:49.104213 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-3993a160-6911-4ae8-aff9-273253be6746 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:49.106240 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-3993a160-6911-4ae8-aff9-273253be6746 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:49.111398 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3993a160-6911-4ae8-aff9-273253be6746 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:49.111876 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3993a160-6911-4ae8-aff9-273253be6746 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:49.112348 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3993a160-6911-4ae8-aff9-273253be6746 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:49.113130 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3993a160-6911-4ae8-aff9-273253be6746 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:49.113522 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3993a160-6911-4ae8-aff9-273253be6746 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:49.113974 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3993a160-6911-4ae8-aff9-273253be6746 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:49.145768 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3993a160-6911-4ae8-aff9-273253be6746 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:49.146284 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3993a160-6911-4ae8-aff9-273253be6746 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:49.146678 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3993a160-6911-4ae8-aff9-273253be6746 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:49.147113 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.objects.instance [None req-3993a160-6911-4ae8-aff9-273253be6746 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lazy-loading 'fault' on Instance uuid 878c924c-fcc8-4dbf-8ea1-132f142e0422 {{(pid=121448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:21:49.187372 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-3993a160-6911-4ae8-aff9-273253be6746 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69dc5c52e36841f5aad028fc6a4b3daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df328392b4f54d0c92df32df0241e95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:49.195705 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-3993a160-6911-4ae8-aff9-273253be6746 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 200 len: 1350 microversion: 2.1 time: 0.095406 Sep 23 15:21:49.196307 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 110/233] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:49 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 1350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:50.219258 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-da4eb4f0-dfe6-4084-aec8-0f6a921218e1 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:50.219879 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-da4eb4f0-dfe6-4084-aec8-0f6a921218e1 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:50.226632 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-da4eb4f0-dfe6-4084-aec8-0f6a921218e1 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:50.227108 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-da4eb4f0-dfe6-4084-aec8-0f6a921218e1 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:50.227542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-da4eb4f0-dfe6-4084-aec8-0f6a921218e1 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:50.228251 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-da4eb4f0-dfe6-4084-aec8-0f6a921218e1 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:50.228712 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-da4eb4f0-dfe6-4084-aec8-0f6a921218e1 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:50.229134 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-da4eb4f0-dfe6-4084-aec8-0f6a921218e1 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:50.243665 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-da4eb4f0-dfe6-4084-aec8-0f6a921218e1 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] HTTP exception thrown: Instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 could not be found. Sep 23 15:21:50.253783 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-da4eb4f0-dfe6-4084-aec8-0f6a921218e1 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Request method failure captured: Sep 23 15:21:50.253783 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 HTTP/1.1 Sep 23 15:21:50.253783 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:21:50.253783 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:21:50.253783 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:21:50.253783 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:21:50.253783 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:21:50.253783 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:21:50.253783 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:21:50.253783 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:21:50.253783 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLc60PaZGDStU0sixgdhQGlz7opOhxY4y2MjuZjAz2MrYBfg-v261-oCB1X5thXavLz8sum1KIE9HvPNqoPfXBSP43vEBg8q6ufbC7uLJLyiWk6Xbo3dkeod23frphgUHyPI2Ta9VvF8mkRewQASZ3Wu_jBlL-8P_sSFMUIFCYhp52Qg Sep 23 15:21:50.253783 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:21:50.253783 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:21:50.253783 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:21:50.253783 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:21:50.253783 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:21:50.253783 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:21:50.253783 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: df328392b4f54d0c92df32df0241e95d Sep 23 15:21:50.253783 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-DeleteServersTestJSON-1908565184 Sep 23 15:21:50.253783 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:21:50.253783 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:21:50.260929 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/df328392b4f54d0c92df32df0241e95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/df328392b4f54d0c92df32df0241e95d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_df328392b4f54d0c92df32df0241e95d", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/df328392b4f54d0c92df32df0241e95d"}]}] Sep 23 15:21:50.260929 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-DeleteServersTestJSON-1908565184 Sep 23 15:21:50.260929 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: df328392b4f54d0c92df32df0241e95d Sep 23 15:21:50.260929 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-DeleteServersTestJSON-1908565184 Sep 23 15:21:50.260929 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-DeleteServersTestJSON-1908565184-project Sep 23 15:21:50.260929 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:21:50.260929 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:21:50.260929 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 69dc5c52e36841f5aad028fc6a4b3daf Sep 23 15:21:50.260929 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-DeleteServersTestJSON-1908565184-project Sep 23 15:21:50.260929 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:21:50.260929 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 could not be found. Sep 23 15:21:50.260929 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '878c924c-fcc8-4dbf-8ea1-132f142e0422'} Sep 23 15:21:50.261800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:21:50.261800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:21:50.261800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:21:50.261800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:21:50.261800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:21:50.261800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:21:50.261800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:21:50.261800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:21:50.261800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:21:50.261800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:21:50.261800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 could not be found. Sep 23 15:21:50.261800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:21:50.261800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:21:50.261800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:21:50.261800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:21:50.261800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:21:50.261800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:21:50.261800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:21:50.261800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:21:50.261800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:21:50.263350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:21:50.263350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:21:50.263350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:21:50.263350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:21:50.263350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:21:50.263350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:21:50.263350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:21:50.263350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 could not be found. Sep 23 15:21:50.263350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:21:50.263350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:21:50.263350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:21:50.263350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:21:50.263350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:21:50.263350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:21:50.263350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:21:50.263350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:21:50.263350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 could not be found. Sep 23 15:21:50.263350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:21:50.264657 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-da4eb4f0-dfe6-4084-aec8-0f6a921218e1 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Returning 404 to user: Instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:21:50.264657 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-da4eb4f0-dfe6-4084-aec8-0f6a921218e1 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 404 len: 111 microversion: 2.1 time: 0.039882 Sep 23 15:21:50.264657 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 124/234] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:50 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:21:50.380503 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a69a27bd-4772-49b8-94db-4b362b8c9a4d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:50.382749 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-a69a27bd-4772-49b8-94db-4b362b8c9a4d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:50.389468 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a69a27bd-4772-49b8-94db-4b362b8c9a4d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:50.389951 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a69a27bd-4772-49b8-94db-4b362b8c9a4d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:50.390385 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a69a27bd-4772-49b8-94db-4b362b8c9a4d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:50.391072 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a69a27bd-4772-49b8-94db-4b362b8c9a4d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:50.391530 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a69a27bd-4772-49b8-94db-4b362b8c9a4d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:50.391952 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a69a27bd-4772-49b8-94db-4b362b8c9a4d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:50.412401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.wsgi [None req-a69a27bd-4772-49b8-94db-4b362b8c9a4d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] HTTP exception thrown: Instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 could not be found. Sep 23 15:21:50.412401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a69a27bd-4772-49b8-94db-4b362b8c9a4d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Request method failure captured: Sep 23 15:21:50.412401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: request: GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422/os-volume_attachments HTTP/1.1 Sep 23 15:21:50.412401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept: application/json Sep 23 15:21:50.412401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept-Encoding: identity Sep 23 15:21:50.412401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Connection: close Sep 23 15:21:50.412401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Length: 0 Sep 23 15:21:50.412401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Type: application/json Sep 23 15:21:50.412401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Host: 10.222.0.55 Sep 23 15:21:50.412401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Openstack-System-Scope: None Sep 23 15:21:50.412401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: User-Agent: python-urllib3/1.26.12 Sep 23 15:21:50.412401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Auth-Token: gAAAAABjLc60PaZGDStU0sixgdhQGlz7opOhxY4y2MjuZjAz2MrYBfg-v261-oCB1X5thXavLz8sum1KIE9HvPNqoPfXBSP43vEBg8q6ufbC7uLJLyiWk6Xbo3dkeod23frphgUHyPI2Ta9VvF8mkRewQASZ3Wu_jBlL-8P_sSFMUIFCYhp52Qg Sep 23 15:21:50.412401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Id: None Sep 23 15:21:50.412401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Name: None Sep 23 15:21:50.412401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Identity-Status: Confirmed Sep 23 15:21:50.412401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Is-Admin-Project: True Sep 23 15:21:50.412401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Id: default Sep 23 15:21:50.412401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Name: Default Sep 23 15:21:50.412401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Id: df328392b4f54d0c92df32df0241e95d Sep 23 15:21:50.412401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Name: tempest-DeleteServersTestJSON-1908565184 Sep 23 15:21:50.412401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Role: reader,member Sep 23 15:21:50.412401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Roles: reader,member Sep 23 15:21:50.414132 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/df328392b4f54d0c92df32df0241e95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/df328392b4f54d0c92df32df0241e95d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_df328392b4f54d0c92df32df0241e95d", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/df328392b4f54d0c92df32df0241e95d"}]}] Sep 23 15:21:50.414132 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant: tempest-DeleteServersTestJSON-1908565184 Sep 23 15:21:50.414132 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Id: df328392b4f54d0c92df32df0241e95d Sep 23 15:21:50.414132 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Name: tempest-DeleteServersTestJSON-1908565184 Sep 23 15:21:50.414132 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User: tempest-DeleteServersTestJSON-1908565184-project Sep 23 15:21:50.414132 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Id: default Sep 23 15:21:50.414132 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Name: Default Sep 23 15:21:50.414132 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Id: 69dc5c52e36841f5aad028fc6a4b3daf Sep 23 15:21:50.414132 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Name: tempest-DeleteServersTestJSON-1908565184-project Sep 23 15:21:50.414132 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: method: > Sep 23 15:21:50.414132 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: exception: Instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 could not be found. Sep 23 15:21:50.414132 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: action_args: {'server_id': '878c924c-fcc8-4dbf-8ea1-132f142e0422'} Sep 23 15:21:50.414961 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:21:50.414961 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:21:50.414961 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:21:50.414961 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:21:50.414961 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:21:50.414961 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:21:50.414961 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:21:50.414961 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:21:50.414961 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:21:50.414961 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:21:50.414961 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 could not be found. Sep 23 15:21:50.414961 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:21:50.414961 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:21:50.414961 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:21:50.414961 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:21:50.414961 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:21:50.414961 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:21:50.414961 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:21:50.414961 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:21:50.414961 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:21:50.416298 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:21:50.416298 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 15:21:50.416298 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 15:21:50.416298 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 15:21:50.416298 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 15:21:50.416298 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 23 15:21:50.416298 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 23 15:21:50.416298 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:21:50.416298 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:21:50.416298 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 could not be found. Sep 23 15:21:50.416298 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:21:50.416298 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:21:50.416298 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:21:50.416298 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:21:50.416298 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:21:50.416298 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:21:50.416298 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:21:50.416298 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:21:50.416298 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 could not be found. Sep 23 15:21:50.416298 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:21:50.418311 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a69a27bd-4772-49b8-94db-4b362b8c9a4d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Returning 404 to user: Instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 could not be found. {{(pid=121448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:21:50.418311 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-a69a27bd-4772-49b8-94db-4b362b8c9a4d tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036585 Sep 23 15:21:50.418311 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 111/235] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Sep 23 15:21:50 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:21:50.790718 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-48ebfbf2-687c-41bb-b862-4f1ad03f4b60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:21:50.793382 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-48ebfbf2-687c-41bb-b862-4f1ad03f4b60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:50.800332 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-48ebfbf2-687c-41bb-b862-4f1ad03f4b60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:50.800806 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-48ebfbf2-687c-41bb-b862-4f1ad03f4b60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:50.801429 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-48ebfbf2-687c-41bb-b862-4f1ad03f4b60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:50.802131 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-48ebfbf2-687c-41bb-b862-4f1ad03f4b60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:50.803100 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-48ebfbf2-687c-41bb-b862-4f1ad03f4b60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:50.803526 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-48ebfbf2-687c-41bb-b862-4f1ad03f4b60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:50.838327 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.objects.instance [None req-48ebfbf2-687c-41bb-b862-4f1ad03f4b60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lazy-loading 'flavor' on Instance uuid 53291dd1-3df2-438e-a2aa-80fa4e76245c {{(pid=121450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:21:51.197921 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-48ebfbf2-687c-41bb-b862-4f1ad03f4b60 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "POST /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c/action" status: 200 len: 32 microversion: 2.1 time: 0.414181 Sep 23 15:21:51.198511 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 125/236] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Sep 23 15:21:50 2022] POST /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c/action => generated 32 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 15:21:51.208854 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-d34e9d92-5a76-43d6-afa7-83ba25f03967 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:51.212317 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-d34e9d92-5a76-43d6-afa7-83ba25f03967 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:51.217045 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d34e9d92-5a76-43d6-afa7-83ba25f03967 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:51.217531 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d34e9d92-5a76-43d6-afa7-83ba25f03967 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:51.217966 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d34e9d92-5a76-43d6-afa7-83ba25f03967 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:51.218658 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d34e9d92-5a76-43d6-afa7-83ba25f03967 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:51.219106 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d34e9d92-5a76-43d6-afa7-83ba25f03967 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:51.219525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d34e9d92-5a76-43d6-afa7-83ba25f03967 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:51.349954 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-d34e9d92-5a76-43d6-afa7-83ba25f03967 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:51.358133 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-d34e9d92-5a76-43d6-afa7-83ba25f03967 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 200 len: 1522 microversion: 2.1 time: 0.153193 Sep 23 15:21:51.358709 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 112/237] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:51 2022] GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:52.382302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-99a094b5-9fe4-4041-bce9-5f8183b691b1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:52.383009 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-99a094b5-9fe4-4041-bce9-5f8183b691b1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:52.389547 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-99a094b5-9fe4-4041-bce9-5f8183b691b1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:52.390022 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-99a094b5-9fe4-4041-bce9-5f8183b691b1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:52.390447 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-99a094b5-9fe4-4041-bce9-5f8183b691b1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:52.391128 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-99a094b5-9fe4-4041-bce9-5f8183b691b1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:52.391635 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-99a094b5-9fe4-4041-bce9-5f8183b691b1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:52.392091 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-99a094b5-9fe4-4041-bce9-5f8183b691b1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:52.529638 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-99a094b5-9fe4-4041-bce9-5f8183b691b1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:52.537714 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-99a094b5-9fe4-4041-bce9-5f8183b691b1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 200 len: 1522 microversion: 2.1 time: 0.160236 Sep 23 15:21:52.538380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 126/238] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:52 2022] GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:53.561918 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-74102f09-a452-461f-a8a4-a5b695077f6f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:53.562539 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-74102f09-a452-461f-a8a4-a5b695077f6f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:53.568776 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-74102f09-a452-461f-a8a4-a5b695077f6f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:53.569268 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-74102f09-a452-461f-a8a4-a5b695077f6f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:53.569766 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-74102f09-a452-461f-a8a4-a5b695077f6f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:53.570464 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-74102f09-a452-461f-a8a4-a5b695077f6f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:53.571142 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-74102f09-a452-461f-a8a4-a5b695077f6f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:53.571850 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-74102f09-a452-461f-a8a4-a5b695077f6f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:53.723858 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-74102f09-a452-461f-a8a4-a5b695077f6f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:53.725242 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-74102f09-a452-461f-a8a4-a5b695077f6f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 200 len: 1522 microversion: 2.1 time: 0.167261 Sep 23 15:21:53.725811 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 113/239] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:53 2022] GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:54.169969 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-aa7e31b1-18b0-4e69-a330-0cb03eb30b73 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:54.170441 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-aa7e31b1-18b0-4e69-a330-0cb03eb30b73 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:54.176781 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-aa7e31b1-18b0-4e69-a330-0cb03eb30b73 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:54.177258 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-aa7e31b1-18b0-4e69-a330-0cb03eb30b73 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:54.177686 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-aa7e31b1-18b0-4e69-a330-0cb03eb30b73 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:54.180511 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-aa7e31b1-18b0-4e69-a330-0cb03eb30b73 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:54.180511 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-aa7e31b1-18b0-4e69-a330-0cb03eb30b73 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:54.180511 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-aa7e31b1-18b0-4e69-a330-0cb03eb30b73 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:54.193996 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-aa7e31b1-18b0-4e69-a330-0cb03eb30b73 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] HTTP exception thrown: Instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 could not be found. Sep 23 15:21:54.195642 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-aa7e31b1-18b0-4e69-a330-0cb03eb30b73 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Request method failure captured: Sep 23 15:21:54.195642 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: DELETE /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 HTTP/1.1 Sep 23 15:21:54.195642 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:21:54.195642 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:21:54.195642 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:21:54.195642 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:21:54.195642 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:21:54.195642 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:21:54.195642 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:21:54.195642 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:21:54.195642 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLc60PaZGDStU0sixgdhQGlz7opOhxY4y2MjuZjAz2MrYBfg-v261-oCB1X5thXavLz8sum1KIE9HvPNqoPfXBSP43vEBg8q6ufbC7uLJLyiWk6Xbo3dkeod23frphgUHyPI2Ta9VvF8mkRewQASZ3Wu_jBlL-8P_sSFMUIFCYhp52Qg Sep 23 15:21:54.195642 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:21:54.195642 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:21:54.195642 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:21:54.195642 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:21:54.195642 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:21:54.195642 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:21:54.195642 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: df328392b4f54d0c92df32df0241e95d Sep 23 15:21:54.195642 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-DeleteServersTestJSON-1908565184 Sep 23 15:21:54.195642 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:21:54.195642 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:21:54.197028 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/df328392b4f54d0c92df32df0241e95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/df328392b4f54d0c92df32df0241e95d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_df328392b4f54d0c92df32df0241e95d", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/df328392b4f54d0c92df32df0241e95d"}]}] Sep 23 15:21:54.197028 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-DeleteServersTestJSON-1908565184 Sep 23 15:21:54.197028 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: df328392b4f54d0c92df32df0241e95d Sep 23 15:21:54.197028 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-DeleteServersTestJSON-1908565184 Sep 23 15:21:54.197028 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-DeleteServersTestJSON-1908565184-project Sep 23 15:21:54.197028 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:21:54.197028 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:21:54.197028 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 69dc5c52e36841f5aad028fc6a4b3daf Sep 23 15:21:54.197028 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-DeleteServersTestJSON-1908565184-project Sep 23 15:21:54.197028 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:21:54.197028 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 could not be found. Sep 23 15:21:54.197028 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '878c924c-fcc8-4dbf-8ea1-132f142e0422'} Sep 23 15:21:54.197951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:21:54.197951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:21:54.197951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:21:54.197951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:21:54.197951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:21:54.197951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:21:54.197951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:21:54.197951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:21:54.197951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:21:54.197951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:21:54.197951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 could not be found. Sep 23 15:21:54.197951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:21:54.197951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:21:54.197951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:21:54.197951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:21:54.197951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:21:54.197951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:21:54.197951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:21:54.197951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:21:54.197951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:21:54.199140 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:21:54.199140 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 15:21:54.199140 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 15:21:54.199140 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 15:21:54.199140 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 15:21:54.199140 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:21:54.199140 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:21:54.199140 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:21:54.199140 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:21:54.199140 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 could not be found. Sep 23 15:21:54.199140 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:21:54.199140 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:21:54.199140 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:21:54.199140 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:21:54.199140 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:21:54.199140 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:21:54.199140 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:21:54.199140 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:21:54.199140 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 could not be found. Sep 23 15:21:54.199140 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:21:54.200260 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-aa7e31b1-18b0-4e69-a330-0cb03eb30b73 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Returning 404 to user: Instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:21:54.200260 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-aa7e31b1-18b0-4e69-a330-0cb03eb30b73 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "DELETE /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 404 len: 111 microversion: 2.1 time: 0.031674 Sep 23 15:21:54.201302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 127/240] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Sep 23 15:21:54 2022] DELETE /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:21:54.214692 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-dd845755-16eb-47f2-bf70-44a030077a07 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:54.215293 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-dd845755-16eb-47f2-bf70-44a030077a07 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] [instance: 878c924c-fcc8-4dbf-8ea1-132f142e0422] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:54.221430 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dd845755-16eb-47f2-bf70-44a030077a07 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:54.221922 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dd845755-16eb-47f2-bf70-44a030077a07 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:54.222370 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dd845755-16eb-47f2-bf70-44a030077a07 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:54.223063 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dd845755-16eb-47f2-bf70-44a030077a07 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:54.223515 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dd845755-16eb-47f2-bf70-44a030077a07 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:54.223937 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dd845755-16eb-47f2-bf70-44a030077a07 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:54.238559 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.wsgi [None req-dd845755-16eb-47f2-bf70-44a030077a07 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] HTTP exception thrown: Instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 could not be found. Sep 23 15:21:54.240718 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-dd845755-16eb-47f2-bf70-44a030077a07 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Request method failure captured: Sep 23 15:21:54.240718 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: request: GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 HTTP/1.1 Sep 23 15:21:54.240718 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept: application/json Sep 23 15:21:54.240718 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept-Encoding: identity Sep 23 15:21:54.240718 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Connection: close Sep 23 15:21:54.240718 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Length: 0 Sep 23 15:21:54.240718 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Type: application/json Sep 23 15:21:54.240718 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Host: 10.222.0.55 Sep 23 15:21:54.240718 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Openstack-System-Scope: None Sep 23 15:21:54.240718 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: User-Agent: python-urllib3/1.26.12 Sep 23 15:21:54.240718 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Auth-Token: gAAAAABjLc60PaZGDStU0sixgdhQGlz7opOhxY4y2MjuZjAz2MrYBfg-v261-oCB1X5thXavLz8sum1KIE9HvPNqoPfXBSP43vEBg8q6ufbC7uLJLyiWk6Xbo3dkeod23frphgUHyPI2Ta9VvF8mkRewQASZ3Wu_jBlL-8P_sSFMUIFCYhp52Qg Sep 23 15:21:54.240718 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Id: None Sep 23 15:21:54.240718 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Name: None Sep 23 15:21:54.240718 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Identity-Status: Confirmed Sep 23 15:21:54.240718 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Is-Admin-Project: True Sep 23 15:21:54.240718 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Id: default Sep 23 15:21:54.240718 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Name: Default Sep 23 15:21:54.240718 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Id: df328392b4f54d0c92df32df0241e95d Sep 23 15:21:54.240718 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Name: tempest-DeleteServersTestJSON-1908565184 Sep 23 15:21:54.240718 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Role: reader,member Sep 23 15:21:54.240718 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Roles: reader,member Sep 23 15:21:54.242108 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/df328392b4f54d0c92df32df0241e95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/df328392b4f54d0c92df32df0241e95d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_df328392b4f54d0c92df32df0241e95d", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/df328392b4f54d0c92df32df0241e95d"}]}] Sep 23 15:21:54.242108 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant: tempest-DeleteServersTestJSON-1908565184 Sep 23 15:21:54.242108 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Id: df328392b4f54d0c92df32df0241e95d Sep 23 15:21:54.242108 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Name: tempest-DeleteServersTestJSON-1908565184 Sep 23 15:21:54.242108 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User: tempest-DeleteServersTestJSON-1908565184-project Sep 23 15:21:54.242108 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Id: default Sep 23 15:21:54.242108 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Name: Default Sep 23 15:21:54.242108 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Id: 69dc5c52e36841f5aad028fc6a4b3daf Sep 23 15:21:54.242108 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Name: tempest-DeleteServersTestJSON-1908565184-project Sep 23 15:21:54.242108 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: method: > Sep 23 15:21:54.242108 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: exception: Instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 could not be found. Sep 23 15:21:54.242108 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: action_args: {'id': '878c924c-fcc8-4dbf-8ea1-132f142e0422'} Sep 23 15:21:54.243051 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:21:54.243051 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:21:54.243051 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:21:54.243051 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:21:54.243051 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:21:54.243051 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:21:54.243051 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:21:54.243051 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:21:54.243051 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:21:54.243051 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:21:54.243051 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 could not be found. Sep 23 15:21:54.243051 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:21:54.243051 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:21:54.243051 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:21:54.243051 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:21:54.243051 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:21:54.243051 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:21:54.243051 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:21:54.243051 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:21:54.243051 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:21:54.244231 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:21:54.244231 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:21:54.244231 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:21:54.244231 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:21:54.244231 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:21:54.244231 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:21:54.244231 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:21:54.244231 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 could not be found. Sep 23 15:21:54.244231 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:21:54.244231 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:21:54.244231 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:21:54.244231 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:21:54.244231 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:21:54.244231 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:21:54.244231 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:21:54.244231 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:21:54.244231 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 could not be found. Sep 23 15:21:54.244231 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:21:54.245594 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-dd845755-16eb-47f2-bf70-44a030077a07 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] Returning 404 to user: Instance 878c924c-fcc8-4dbf-8ea1-132f142e0422 could not be found. {{(pid=121448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:21:54.245594 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-dd845755-16eb-47f2-bf70-44a030077a07 tempest-DeleteServersTestJSON-1908565184 tempest-DeleteServersTestJSON-1908565184-project] 10.222.0.55 "GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422" status: 404 len: 111 microversion: 2.1 time: 0.031305 Sep 23 15:21:54.245594 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 114/241] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:54 2022] GET /compute/v2.1/servers/878c924c-fcc8-4dbf-8ea1-132f142e0422 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 15:21:54.750297 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b174aade-3473-4730-8932-e4b80a24e2f0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:54.751177 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-b174aade-3473-4730-8932-e4b80a24e2f0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:54.771046 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b174aade-3473-4730-8932-e4b80a24e2f0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:54.772099 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b174aade-3473-4730-8932-e4b80a24e2f0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:54.774807 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b174aade-3473-4730-8932-e4b80a24e2f0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:54.775582 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b174aade-3473-4730-8932-e4b80a24e2f0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:54.776084 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b174aade-3473-4730-8932-e4b80a24e2f0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:54.776520 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b174aade-3473-4730-8932-e4b80a24e2f0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:54.828553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:21:55.270211 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-b174aade-3473-4730-8932-e4b80a24e2f0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:55.280018 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-b174aade-3473-4730-8932-e4b80a24e2f0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 200 len: 1522 microversion: 2.1 time: 0.536058 Sep 23 15:21:55.281201 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 128/242] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:54 2022] GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 1522 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:21:56.305783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-49acf672-d272-43a3-a7a3-4093574ac8c2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:56.306626 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-49acf672-d272-43a3-a7a3-4093574ac8c2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:56.316576 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-49acf672-d272-43a3-a7a3-4093574ac8c2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:56.319646 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-49acf672-d272-43a3-a7a3-4093574ac8c2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:56.322846 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-49acf672-d272-43a3-a7a3-4093574ac8c2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:56.323823 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-49acf672-d272-43a3-a7a3-4093574ac8c2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:56.324590 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-49acf672-d272-43a3-a7a3-4093574ac8c2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:56.327020 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-49acf672-d272-43a3-a7a3-4093574ac8c2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:56.563476 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-49acf672-d272-43a3-a7a3-4093574ac8c2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:56.571279 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-49acf672-d272-43a3-a7a3-4093574ac8c2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 200 len: 1522 microversion: 2.1 time: 0.269944 Sep 23 15:21:56.571848 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 115/243] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:56 2022] GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:57.595470 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-f0d53af8-37a9-4cb0-a604-262c0969a5d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:57.596100 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-f0d53af8-37a9-4cb0-a604-262c0969a5d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:57.603826 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f0d53af8-37a9-4cb0-a604-262c0969a5d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:57.604396 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f0d53af8-37a9-4cb0-a604-262c0969a5d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:57.604833 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f0d53af8-37a9-4cb0-a604-262c0969a5d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:57.611059 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f0d53af8-37a9-4cb0-a604-262c0969a5d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:57.611059 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f0d53af8-37a9-4cb0-a604-262c0969a5d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:57.611059 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f0d53af8-37a9-4cb0-a604-262c0969a5d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:57.747663 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-f0d53af8-37a9-4cb0-a604-262c0969a5d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:57.752948 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-f0d53af8-37a9-4cb0-a604-262c0969a5d6 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 200 len: 1522 microversion: 2.1 time: 0.162117 Sep 23 15:21:57.753471 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 129/244] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:57 2022] GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:58.781211 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-32b6fd80-2840-460a-b092-9ed0cb1bea57 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:58.782053 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-32b6fd80-2840-460a-b092-9ed0cb1bea57 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:58.793041 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-32b6fd80-2840-460a-b092-9ed0cb1bea57 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:58.795876 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-32b6fd80-2840-460a-b092-9ed0cb1bea57 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:58.796537 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-32b6fd80-2840-460a-b092-9ed0cb1bea57 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:58.797626 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-32b6fd80-2840-460a-b092-9ed0cb1bea57 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:58.798908 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-32b6fd80-2840-460a-b092-9ed0cb1bea57 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:58.799345 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-32b6fd80-2840-460a-b092-9ed0cb1bea57 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:58.969440 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-32b6fd80-2840-460a-b092-9ed0cb1bea57 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:58.977764 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-32b6fd80-2840-460a-b092-9ed0cb1bea57 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 200 len: 1522 microversion: 2.1 time: 0.204440 Sep 23 15:21:58.978337 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 116/245] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:58 2022] GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:00.001952 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-9ce9d443-2350-4042-af67-f301d6cf0c4a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:00.003412 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-9ce9d443-2350-4042-af67-f301d6cf0c4a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:00.011796 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9ce9d443-2350-4042-af67-f301d6cf0c4a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:00.012420 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9ce9d443-2350-4042-af67-f301d6cf0c4a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:00.012915 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9ce9d443-2350-4042-af67-f301d6cf0c4a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:00.013969 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9ce9d443-2350-4042-af67-f301d6cf0c4a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:00.014417 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9ce9d443-2350-4042-af67-f301d6cf0c4a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:00.014918 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9ce9d443-2350-4042-af67-f301d6cf0c4a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:00.155947 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-9ce9d443-2350-4042-af67-f301d6cf0c4a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:00.163692 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-9ce9d443-2350-4042-af67-f301d6cf0c4a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 200 len: 1522 microversion: 2.1 time: 0.166770 Sep 23 15:22:00.164751 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 130/246] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:59 2022] GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:01.188395 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-353f6239-a223-4ffb-a706-4c5940c57dae tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:01.189378 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-353f6239-a223-4ffb-a706-4c5940c57dae tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:01.199822 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-353f6239-a223-4ffb-a706-4c5940c57dae tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:01.200951 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-353f6239-a223-4ffb-a706-4c5940c57dae tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:01.201458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-353f6239-a223-4ffb-a706-4c5940c57dae tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:01.202309 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-353f6239-a223-4ffb-a706-4c5940c57dae tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:01.202907 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-353f6239-a223-4ffb-a706-4c5940c57dae tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:01.203398 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-353f6239-a223-4ffb-a706-4c5940c57dae tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:01.363424 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-353f6239-a223-4ffb-a706-4c5940c57dae tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:01.372325 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-353f6239-a223-4ffb-a706-4c5940c57dae tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 200 len: 1522 microversion: 2.1 time: 0.187659 Sep 23 15:22:01.373471 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 117/247] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:01 2022] GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:02.404942 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-5c3fba27-d134-42b6-8d10-ed1f2e7021c1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:02.405787 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-5c3fba27-d134-42b6-8d10-ed1f2e7021c1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:02.427894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5c3fba27-d134-42b6-8d10-ed1f2e7021c1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:02.427894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5c3fba27-d134-42b6-8d10-ed1f2e7021c1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:02.427894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5c3fba27-d134-42b6-8d10-ed1f2e7021c1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:02.427894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5c3fba27-d134-42b6-8d10-ed1f2e7021c1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:02.428242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5c3fba27-d134-42b6-8d10-ed1f2e7021c1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:02.428242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5c3fba27-d134-42b6-8d10-ed1f2e7021c1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:02.664953 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-5c3fba27-d134-42b6-8d10-ed1f2e7021c1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:02.673783 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-5c3fba27-d134-42b6-8d10-ed1f2e7021c1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 200 len: 1522 microversion: 2.1 time: 0.276774 Sep 23 15:22:02.688481 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 131/248] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:02 2022] GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:03.701124 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-7895a4b7-77a1-43aa-8753-b7dff89e3fff tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:03.714148 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-7895a4b7-77a1-43aa-8753-b7dff89e3fff tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:03.728157 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7895a4b7-77a1-43aa-8753-b7dff89e3fff tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:03.729054 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7895a4b7-77a1-43aa-8753-b7dff89e3fff tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:03.729654 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7895a4b7-77a1-43aa-8753-b7dff89e3fff tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:03.730512 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7895a4b7-77a1-43aa-8753-b7dff89e3fff tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:03.731128 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7895a4b7-77a1-43aa-8753-b7dff89e3fff tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:03.731566 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7895a4b7-77a1-43aa-8753-b7dff89e3fff tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:03.935050 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-7895a4b7-77a1-43aa-8753-b7dff89e3fff tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:03.943892 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-7895a4b7-77a1-43aa-8753-b7dff89e3fff tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 200 len: 1522 microversion: 2.1 time: 0.249008 Sep 23 15:22:03.944545 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 118/249] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:03 2022] GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:04.968037 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-eb3ec5d0-ca38-4fab-b5d8-88d02d5c18f1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:04.969482 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-eb3ec5d0-ca38-4fab-b5d8-88d02d5c18f1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:04.977958 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eb3ec5d0-ca38-4fab-b5d8-88d02d5c18f1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:04.978708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eb3ec5d0-ca38-4fab-b5d8-88d02d5c18f1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:04.979320 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eb3ec5d0-ca38-4fab-b5d8-88d02d5c18f1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:04.980221 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eb3ec5d0-ca38-4fab-b5d8-88d02d5c18f1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:04.981018 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eb3ec5d0-ca38-4fab-b5d8-88d02d5c18f1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:04.981612 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eb3ec5d0-ca38-4fab-b5d8-88d02d5c18f1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:05.245975 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-eb3ec5d0-ca38-4fab-b5d8-88d02d5c18f1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:05.259469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-eb3ec5d0-ca38-4fab-b5d8-88d02d5c18f1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 200 len: 1522 microversion: 2.1 time: 0.295883 Sep 23 15:22:05.260481 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 132/250] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:04 2022] GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:06.288072 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-664b8052-8774-47d5-b3c6-8ae697fce1c8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:06.288699 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-664b8052-8774-47d5-b3c6-8ae697fce1c8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:06.290547 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_api:SELECT=44 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:06.295374 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-664b8052-8774-47d5-b3c6-8ae697fce1c8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:06.296096 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-664b8052-8774-47d5-b3c6-8ae697fce1c8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:06.296658 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-664b8052-8774-47d5-b3c6-8ae697fce1c8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:06.297368 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-664b8052-8774-47d5-b3c6-8ae697fce1c8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:06.297823 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-664b8052-8774-47d5-b3c6-8ae697fce1c8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:06.298248 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-664b8052-8774-47d5-b3c6-8ae697fce1c8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:06.430600 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-664b8052-8774-47d5-b3c6-8ae697fce1c8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:06.438308 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=100 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:06.440545 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-664b8052-8774-47d5-b3c6-8ae697fce1c8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 200 len: 1522 microversion: 2.1 time: 0.156195 Sep 23 15:22:06.441124 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 119/251] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:06 2022] GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:07.464694 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-c4f8fe72-3884-4a25-9957-02a0faeebc4e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:07.465653 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-c4f8fe72-3884-4a25-9957-02a0faeebc4e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:07.475933 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c4f8fe72-3884-4a25-9957-02a0faeebc4e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:07.476633 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c4f8fe72-3884-4a25-9957-02a0faeebc4e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:07.477244 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c4f8fe72-3884-4a25-9957-02a0faeebc4e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:07.478127 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c4f8fe72-3884-4a25-9957-02a0faeebc4e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:07.478731 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c4f8fe72-3884-4a25-9957-02a0faeebc4e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:07.479310 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c4f8fe72-3884-4a25-9957-02a0faeebc4e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:07.791787 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-c4f8fe72-3884-4a25-9957-02a0faeebc4e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:07.800889 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-c4f8fe72-3884-4a25-9957-02a0faeebc4e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 200 len: 1502 microversion: 2.1 time: 0.341248 Sep 23 15:22:07.801557 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 133/252] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:07 2022] GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 1502 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:07.826386 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-b781f942-ba5e-4735-9b52-5a23bb4a5c04 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd0a8802-1888-4071-b178-4563674439a9"}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:22:07.829215 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-b781f942-ba5e-4735-9b52-5a23bb4a5c04 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:07.837614 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b781f942-ba5e-4735-9b52-5a23bb4a5c04 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:07.838144 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b781f942-ba5e-4735-9b52-5a23bb4a5c04 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:07.838970 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b781f942-ba5e-4735-9b52-5a23bb4a5c04 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:07.839833 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b781f942-ba5e-4735-9b52-5a23bb4a5c04 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:07.840463 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b781f942-ba5e-4735-9b52-5a23bb4a5c04 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:07.841044 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b781f942-ba5e-4735-9b52-5a23bb4a5c04 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:07.878868 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.wsgi [None req-b781f942-ba5e-4735-9b52-5a23bb4a5c04 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] HTTP exception thrown: Cannot 'attach_volume' instance 53291dd1-3df2-438e-a2aa-80fa4e76245c while it is in vm_state rescued Sep 23 15:22:07.881151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-b781f942-ba5e-4735-9b52-5a23bb4a5c04 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Request method failure captured: Sep 23 15:22:07.881151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: request: POST /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c/os-volume_attachments HTTP/1.1 Sep 23 15:22:07.881151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept: application/json Sep 23 15:22:07.881151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept-Encoding: identity Sep 23 15:22:07.881151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Connection: close Sep 23 15:22:07.881151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Length: 74 Sep 23 15:22:07.881151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Type: application/json Sep 23 15:22:07.881151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Host: 10.222.0.55 Sep 23 15:22:07.881151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Openstack-System-Scope: None Sep 23 15:22:07.881151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: User-Agent: python-urllib3/1.26.12 Sep 23 15:22:07.881151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Auth-Token: gAAAAABjLc6x1LAOulyIycgRWUTc_jBmYLdDkQeiPfEhd77MBPxxixMXuHzzzsoTpzWc9k5txbSC3yFLrYFV49oF9-wag1dL88k2AX-bXsZGWgKX7IVmHTshTzZJzO_SpP3I_fgqCNWPxP9LPw1RpnK99IMWBDohTuycUChJ76IguAfj1MEZ7Hw Sep 23 15:22:07.881151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Id: None Sep 23 15:22:07.881151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Name: None Sep 23 15:22:07.881151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Identity-Status: Confirmed Sep 23 15:22:07.881151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Is-Admin-Project: True Sep 23 15:22:07.881151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Id: default Sep 23 15:22:07.881151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Name: Default Sep 23 15:22:07.881151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Id: a079aa0c75bf44619342f53006d88ff9 Sep 23 15:22:07.881151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-717875198 Sep 23 15:22:07.881151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Role: reader,member Sep 23 15:22:07.881151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Roles: reader,member Sep 23 15:22:07.882609 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a079aa0c75bf44619342f53006d88ff9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a079aa0c75bf44619342f53006d88ff9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a079aa0c75bf44619342f53006d88ff9", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a079aa0c75bf44619342f53006d88ff9"}]}] Sep 23 15:22:07.882609 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant: tempest-ServerRescueNegativeTestJSON-717875198 Sep 23 15:22:07.882609 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Id: a079aa0c75bf44619342f53006d88ff9 Sep 23 15:22:07.882609 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-717875198 Sep 23 15:22:07.882609 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User: tempest-ServerRescueNegativeTestJSON-717875198-project Sep 23 15:22:07.882609 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Id: default Sep 23 15:22:07.882609 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Name: Default Sep 23 15:22:07.882609 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Id: a5514abdc8b54282901367a4f2d02856 Sep 23 15:22:07.882609 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Name: tempest-ServerRescueNegativeTestJSON-717875198-project Sep 23 15:22:07.882609 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Sep 23 15:22:07.882609 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: {"volumeAttachment": {"volumeId": "cd0a8802-1888-4071-b178-4563674439a9"}} Sep 23 15:22:07.882609 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: method: > Sep 23 15:22:07.883551 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: exception: Cannot 'attach_volume' instance 53291dd1-3df2-438e-a2aa-80fa4e76245c while it is in vm_state rescued Sep 23 15:22:07.883551 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: action_args: {'server_id': '53291dd1-3df2-438e-a2aa-80fa4e76245c', 'body': {'volumeAttachment': {'volumeId': 'cd0a8802-1888-4071-b178-4563674439a9'}}} Sep 23 15:22:07.883551 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:22:07.883551 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:22:07.883551 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 23 15:22:07.883551 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 23 15:22:07.883551 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 15:22:07.883551 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 15:22:07.883551 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 15:22:07.883551 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 15:22:07.883551 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 53291dd1-3df2-438e-a2aa-80fa4e76245c in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 23 15:22:07.883551 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:22:07.883551 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:22:07.883551 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:22:07.883551 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:22:07.883551 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:22:07.883551 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:22:07.883551 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:22:07.883551 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:22:07.885161 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:22:07.885161 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:22:07.885161 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 15:22:07.885161 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 15:22:07.885161 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 15:22:07.885161 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 15:22:07.885161 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 15:22:07.885161 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 15:22:07.885161 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 23 15:22:07.885161 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 15:22:07.885161 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 15:22:07.885161 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 15:22:07.885161 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 53291dd1-3df2-438e-a2aa-80fa4e76245c while it is in vm_state rescued Sep 23 15:22:07.885161 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:22:07.885161 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:22:07.885161 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:22:07.885161 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:22:07.885161 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:22:07.885161 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:22:07.886593 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:22:07.886593 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:22:07.886593 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 53291dd1-3df2-438e-a2aa-80fa4e76245c while it is in vm_state rescued Sep 23 15:22:07.886593 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:22:07.887598 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-b781f942-ba5e-4735-9b52-5a23bb4a5c04 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Returning 409 to user: Cannot 'attach_volume' instance 53291dd1-3df2-438e-a2aa-80fa4e76245c while it is in vm_state rescued {{(pid=121448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:22:07.888623 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-b781f942-ba5e-4735-9b52-5a23bb4a5c04 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "POST /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.066937 Sep 23 15:22:07.889828 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 120/253] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Sep 23 15:22:07 2022] POST /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c/os-volume_attachments => generated 152 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 15:22:07.898866 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-c03f1a9c-68ef-44ce-8b03-7d7452c5efb2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:22:07.899505 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-c03f1a9c-68ef-44ce-8b03-7d7452c5efb2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:07.905927 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c03f1a9c-68ef-44ce-8b03-7d7452c5efb2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:07.906604 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c03f1a9c-68ef-44ce-8b03-7d7452c5efb2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:07.907043 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c03f1a9c-68ef-44ce-8b03-7d7452c5efb2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:07.908344 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c03f1a9c-68ef-44ce-8b03-7d7452c5efb2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:07.909015 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c03f1a9c-68ef-44ce-8b03-7d7452c5efb2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:07.909618 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c03f1a9c-68ef-44ce-8b03-7d7452c5efb2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:08.258342 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-c03f1a9c-68ef-44ce-8b03-7d7452c5efb2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "POST /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c/action" status: 202 len: 0 microversion: 2.1 time: 0.363307 Sep 23 15:22:08.259323 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 134/254] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Sep 23 15:22:07 2022] POST /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:22:08.268819 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-27c190a7-cb73-4009-aed6-299fbe4f1135 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:08.269516 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-27c190a7-cb73-4009-aed6-299fbe4f1135 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:08.282673 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-27c190a7-cb73-4009-aed6-299fbe4f1135 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:08.282673 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-27c190a7-cb73-4009-aed6-299fbe4f1135 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:08.282673 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-27c190a7-cb73-4009-aed6-299fbe4f1135 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:08.282673 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-27c190a7-cb73-4009-aed6-299fbe4f1135 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:08.283122 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-27c190a7-cb73-4009-aed6-299fbe4f1135 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:08.283122 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-27c190a7-cb73-4009-aed6-299fbe4f1135 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:08.428579 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-27c190a7-cb73-4009-aed6-299fbe4f1135 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:08.436391 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-27c190a7-cb73-4009-aed6-299fbe4f1135 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 200 len: 1510 microversion: 2.1 time: 0.172154 Sep 23 15:22:08.436968 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 121/255] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:08 2022] GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:09.462296 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-9a5989a9-6165-45fb-abb5-fbd34d134981 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:09.463000 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-9a5989a9-6165-45fb-abb5-fbd34d134981 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:09.470191 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9a5989a9-6165-45fb-abb5-fbd34d134981 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:09.470689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9a5989a9-6165-45fb-abb5-fbd34d134981 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:09.471123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9a5989a9-6165-45fb-abb5-fbd34d134981 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:09.471822 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9a5989a9-6165-45fb-abb5-fbd34d134981 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:09.472305 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9a5989a9-6165-45fb-abb5-fbd34d134981 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:09.472777 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9a5989a9-6165-45fb-abb5-fbd34d134981 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:09.692626 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-9a5989a9-6165-45fb-abb5-fbd34d134981 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:09.711330 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-9a5989a9-6165-45fb-abb5-fbd34d134981 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 200 len: 1510 microversion: 2.1 time: 0.251925 Sep 23 15:22:09.711330 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 135/256] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:09 2022] GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 1510 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:10.748386 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-34490cec-16f1-41a0-bc40-2b9d9796d3f8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:10.748386 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-34490cec-16f1-41a0-bc40-2b9d9796d3f8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:10.754524 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-34490cec-16f1-41a0-bc40-2b9d9796d3f8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:10.755127 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-34490cec-16f1-41a0-bc40-2b9d9796d3f8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:10.755763 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-34490cec-16f1-41a0-bc40-2b9d9796d3f8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:10.756679 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-34490cec-16f1-41a0-bc40-2b9d9796d3f8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:10.757397 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-34490cec-16f1-41a0-bc40-2b9d9796d3f8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:10.758043 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-34490cec-16f1-41a0-bc40-2b9d9796d3f8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:11.056710 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-34490cec-16f1-41a0-bc40-2b9d9796d3f8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:11.065169 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-34490cec-16f1-41a0-bc40-2b9d9796d3f8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 200 len: 1510 microversion: 2.1 time: 0.330255 Sep 23 15:22:11.065743 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 122/257] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:10 2022] GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 1510 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:12.096863 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-61784bdf-c0c8-4e6b-95f0-c2f2cfb71805 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:12.096863 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-61784bdf-c0c8-4e6b-95f0-c2f2cfb71805 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:12.117445 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-61784bdf-c0c8-4e6b-95f0-c2f2cfb71805 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:12.117941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-61784bdf-c0c8-4e6b-95f0-c2f2cfb71805 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:12.118383 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-61784bdf-c0c8-4e6b-95f0-c2f2cfb71805 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:12.120675 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-61784bdf-c0c8-4e6b-95f0-c2f2cfb71805 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:12.121152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-61784bdf-c0c8-4e6b-95f0-c2f2cfb71805 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:12.121580 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-61784bdf-c0c8-4e6b-95f0-c2f2cfb71805 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:12.324054 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-61784bdf-c0c8-4e6b-95f0-c2f2cfb71805 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:12.350469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-61784bdf-c0c8-4e6b-95f0-c2f2cfb71805 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 200 len: 1510 microversion: 2.1 time: 0.260603 Sep 23 15:22:12.351196 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 136/258] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:12 2022] GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 1510 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:13.376229 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6a89567b-784c-4bd4-8080-e21d81461ad0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:13.377220 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-6a89567b-784c-4bd4-8080-e21d81461ad0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:13.386423 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6a89567b-784c-4bd4-8080-e21d81461ad0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:13.387220 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6a89567b-784c-4bd4-8080-e21d81461ad0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:13.387923 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6a89567b-784c-4bd4-8080-e21d81461ad0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:13.389427 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6a89567b-784c-4bd4-8080-e21d81461ad0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:13.390085 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6a89567b-784c-4bd4-8080-e21d81461ad0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:13.391242 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6a89567b-784c-4bd4-8080-e21d81461ad0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:13.575491 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6a89567b-784c-4bd4-8080-e21d81461ad0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:13.586441 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-6a89567b-784c-4bd4-8080-e21d81461ad0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 200 len: 1516 microversion: 2.1 time: 0.215109 Sep 23 15:22:13.587913 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 123/259] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:13 2022] GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 1516 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:16.975398 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-3de23f10-c41d-4ebc-bf60-bb22a476257d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Action: 'create', calling method: .version_select at 0x7f82dbdee040>, body: {"keypair": {"name": "tempest-keypair-1724063594", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTDFzGT1Zksi8zFLGYDmJMqn1tpJJHHPEBGbTIuaghvKRC2TeENhfQZo2OxjqOj2/8Jdmw+sZq5Ie6+NUZnNkq2XaPo/y6cJFSbHDShDjaH8mumuf0dy2NCYPnMeVyIHw=="}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:22:16.995428 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-3de23f10-c41d-4ebc-bf60-bb22a476257d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Getting quotas for project a079aa0c75bf44619342f53006d88ff9. Resources: {'key_pairs'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:22:16.999524 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-3de23f10-c41d-4ebc-bf60-bb22a476257d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Getting quotas for user a5514abdc8b54282901367a4f2d02856 and project a079aa0c75bf44619342f53006d88ff9. Resources: {'key_pairs'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:22:17.116755 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-3de23f10-c41d-4ebc-bf60-bb22a476257d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.145026 Sep 23 15:22:17.122635 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 137/260] 10.222.0.55 () {60 vars in 1159 bytes} [Fri Sep 23 15:22:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:22:18.726334 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6770bd27-482d-439a-a92b-d65b976319e9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:18.727410 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-6770bd27-482d-439a-a92b-d65b976319e9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:18.734841 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6770bd27-482d-439a-a92b-d65b976319e9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:18.735457 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6770bd27-482d-439a-a92b-d65b976319e9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:18.735895 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6770bd27-482d-439a-a92b-d65b976319e9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:18.736797 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6770bd27-482d-439a-a92b-d65b976319e9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:18.737335 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6770bd27-482d-439a-a92b-d65b976319e9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:18.737925 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6770bd27-482d-439a-a92b-d65b976319e9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:18.770042 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-6770bd27-482d-439a-a92b-d65b976319e9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca/ips" status: 200 len: 151 microversion: 2.20 time: 0.047729 Sep 23 15:22:18.776471 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 124/261] 10.222.0.55 () {60 vars in 1289 bytes} [Fri Sep 23 15:22:18 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca/ips => generated 151 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:22:18.884322 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-2d8600ec-e780-473b-9f83-aae4fb16ab92 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:18.884980 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-2d8600ec-e780-473b-9f83-aae4fb16ab92 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:18.893732 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2d8600ec-e780-473b-9f83-aae4fb16ab92 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:18.894318 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2d8600ec-e780-473b-9f83-aae4fb16ab92 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:18.894827 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2d8600ec-e780-473b-9f83-aae4fb16ab92 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:18.897136 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2d8600ec-e780-473b-9f83-aae4fb16ab92 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:18.897622 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2d8600ec-e780-473b-9f83-aae4fb16ab92 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:18.898044 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2d8600ec-e780-473b-9f83-aae4fb16ab92 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:18.932867 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-2d8600ec-e780-473b-9f83-aae4fb16ab92 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f/ips" status: 200 len: 144 microversion: 2.1 time: 0.053032 Sep 23 15:22:18.933765 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 138/262] 10.222.0.55 () {58 vars in 1248 bytes} [Fri Sep 23 15:22:18 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f/ips => generated 144 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:22:22.137291 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-57a4c90b-2bea-49ea-8730-be799b8522cb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-534681158", "imageRef": "051c4746-7f50-4edb-b09d-a8935df360de", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0fed3158-67d0-44f2-9c11-c1330461e633"}], "security_groups": [{"name": "tempest-securitygroup--1697386057"}], "key_name": "tempest-keypair-1724063594", "user_data": "}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:22:22.196031 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a3857e21-aa9e-4943-9013-9c769720cd69 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2be6f895-4a33-4397-981b-58254329fc95"}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:22:22.201541 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-a3857e21-aa9e-4943-9013-9c769720cd69 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:22.209478 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:22.227759 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a3857e21-aa9e-4943-9013-9c769720cd69 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:22.228469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a3857e21-aa9e-4943-9013-9c769720cd69 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:22.233319 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a3857e21-aa9e-4943-9013-9c769720cd69 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:22.234062 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a3857e21-aa9e-4943-9013-9c769720cd69 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:22.234608 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a3857e21-aa9e-4943-9013-9c769720cd69 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:22.237215 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a3857e21-aa9e-4943-9013-9c769720cd69 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:22.406988 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.network.neutron [None req-57a4c90b-2bea-49ea-8730-be799b8522cb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] validate_networks() for [('0fed3158-67d0-44f2-9c11-c1330461e633', None, None, None, None, None)] {{(pid=121448) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:22:23.042823 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-57a4c90b-2bea-49ea-8730-be799b8522cb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Flavor limits 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:22:23.043374 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-57a4c90b-2bea-49ea-8730-be799b8522cb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Image limits 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:22:23.043959 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-57a4c90b-2bea-49ea-8730-be799b8522cb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Flavor pref 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:22:23.044497 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-57a4c90b-2bea-49ea-8730-be799b8522cb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Image pref 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:22:23.045016 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-57a4c90b-2bea-49ea-8730-be799b8522cb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:22:23.054884 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-57a4c90b-2bea-49ea-8730-be799b8522cb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:23.055619 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-57a4c90b-2bea-49ea-8730-be799b8522cb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:23.056217 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-57a4c90b-2bea-49ea-8730-be799b8522cb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:23.057047 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-57a4c90b-2bea-49ea-8730-be799b8522cb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:23.057605 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-57a4c90b-2bea-49ea-8730-be799b8522cb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:23.058139 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-57a4c90b-2bea-49ea-8730-be799b8522cb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:23.081619 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-57a4c90b-2bea-49ea-8730-be799b8522cb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Getting quotas for project a079aa0c75bf44619342f53006d88ff9. Resources: {'ram', 'instances', 'cores'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:22:23.087828 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-57a4c90b-2bea-49ea-8730-be799b8522cb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Getting quotas for user a5514abdc8b54282901367a4f2d02856 and project a079aa0c75bf44619342f53006d88ff9. Resources: {'ram', 'instances', 'cores'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:22:23.100721 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-57a4c90b-2bea-49ea-8730-be799b8522cb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Going to run 1 instances... {{(pid=121448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:22:23.103815 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-57a4c90b-2bea-49ea-8730-be799b8522cb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='051c4746-7f50-4edb-b09d-a8935df360de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:22:23.351277 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-57a4c90b-2bea-49ea-8730-be799b8522cb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.224274 Sep 23 15:22:23.351952 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 125/263] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Sep 23 15:22:22 2022] POST /compute/v2.1/servers => generated 409 bytes in 1226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:22:23.364167 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-b449ba05-5015-44f1-a917-cffbbc9575cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:22:23.367489 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-b449ba05-5015-44f1-a917-cffbbc9575cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:23.377053 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b449ba05-5015-44f1-a917-cffbbc9575cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:23.377053 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b449ba05-5015-44f1-a917-cffbbc9575cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:23.377053 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b449ba05-5015-44f1-a917-cffbbc9575cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:23.377053 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b449ba05-5015-44f1-a917-cffbbc9575cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:23.377398 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b449ba05-5015-44f1-a917-cffbbc9575cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:23.377398 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b449ba05-5015-44f1-a917-cffbbc9575cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:23.414808 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.objects.instance [None req-b449ba05-5015-44f1-a917-cffbbc9575cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lazy-loading 'flavor' on Instance uuid 4bba6fdd-bec4-491e-81ba-f3a9863f72ca {{(pid=121448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:22:24.084898 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-a3857e21-aa9e-4943-9013-9c769720cd69 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "POST /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.883900 Sep 23 15:22:24.091056 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 139/264] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Sep 23 15:22:22 2022] POST /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f/os-volume_attachments => generated 194 bytes in 1900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:22:24.103709 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-02e095c0-afc3-4148-a2c3-f338c642c2a0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:24.105282 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-02e095c0-afc3-4148-a2c3-f338c642c2a0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:24.166708 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-b449ba05-5015-44f1-a917-cffbbc9575cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "POST /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca/action" status: 202 len: 0 microversion: 2.20 time: 0.807117 Sep 23 15:22:24.167659 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 126/265] 10.222.0.55 () {62 vars in 1319 bytes} [Fri Sep 23 15:22:23 2022] POST /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca/action => generated 0 bytes in 815 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:22:24.182237 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-1519eb60-cd54-4d6a-861a-01dddb67b95f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:24.183304 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-1519eb60-cd54-4d6a-861a-01dddb67b95f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:24.192333 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1519eb60-cd54-4d6a-861a-01dddb67b95f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:24.192832 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1519eb60-cd54-4d6a-861a-01dddb67b95f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:24.193269 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1519eb60-cd54-4d6a-861a-01dddb67b95f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:24.193996 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1519eb60-cd54-4d6a-861a-01dddb67b95f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:24.194439 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1519eb60-cd54-4d6a-861a-01dddb67b95f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:24.194864 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1519eb60-cd54-4d6a-861a-01dddb67b95f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:24.196654 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-02e095c0-afc3-4148-a2c3-f338c642c2a0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:24.205418 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-02e095c0-afc3-4148-a2c3-f338c642c2a0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1245 microversion: 2.1 time: 0.112767 Sep 23 15:22:24.206659 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 140/266] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:24 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1245 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:24.367541 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-1519eb60-cd54-4d6a-861a-01dddb67b95f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:24.401498 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-1519eb60-cd54-4d6a-861a-01dddb67b95f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:24.401498 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-1519eb60-cd54-4d6a-861a-01dddb67b95f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:24.401498 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-1519eb60-cd54-4d6a-861a-01dddb67b95f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1724 microversion: 2.20 time: 0.220037 Sep 23 15:22:24.407922 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 127/267] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:24 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:22:25.232725 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-24dc788a-adaf-4ff2-9f99-521cf6206a41 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:25.233334 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-24dc788a-adaf-4ff2-9f99-521cf6206a41 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:25.247710 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-24dc788a-adaf-4ff2-9f99-521cf6206a41 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:25.247710 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-24dc788a-adaf-4ff2-9f99-521cf6206a41 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:25.247710 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-24dc788a-adaf-4ff2-9f99-521cf6206a41 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:25.247710 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-24dc788a-adaf-4ff2-9f99-521cf6206a41 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:25.248138 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-24dc788a-adaf-4ff2-9f99-521cf6206a41 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:25.248138 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-24dc788a-adaf-4ff2-9f99-521cf6206a41 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:25.333364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-24dc788a-adaf-4ff2-9f99-521cf6206a41 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:25.345299 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-24dc788a-adaf-4ff2-9f99-521cf6206a41 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1249 microversion: 2.1 time: 0.112759 Sep 23 15:22:25.360687 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 141/268] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:25 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1249 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:22:25.426787 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-7c1156b7-988f-4b10-a5b5-99444300de19 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:25.427456 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-7c1156b7-988f-4b10-a5b5-99444300de19 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:25.434421 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7c1156b7-988f-4b10-a5b5-99444300de19 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:25.434947 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7c1156b7-988f-4b10-a5b5-99444300de19 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:25.435356 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7c1156b7-988f-4b10-a5b5-99444300de19 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:25.436117 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7c1156b7-988f-4b10-a5b5-99444300de19 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:25.436668 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7c1156b7-988f-4b10-a5b5-99444300de19 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:25.437001 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7c1156b7-988f-4b10-a5b5-99444300de19 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:25.594441 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-7c1156b7-988f-4b10-a5b5-99444300de19 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:25.605338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-7c1156b7-988f-4b10-a5b5-99444300de19 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:25.608997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-7c1156b7-988f-4b10-a5b5-99444300de19 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:25.608997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-7c1156b7-988f-4b10-a5b5-99444300de19 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1724 microversion: 2.20 time: 0.187230 Sep 23 15:22:25.609638 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 128/269] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:25 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:22:26.215452 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-af2f15b7-b6e0-4415-b94c-32e0cadaf25b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Action: 'create', calling method: .version_select at 0x7f82dbd6b1f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2003426208", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACgcVRmvsyISmrHFmQL35Kerrm3lrMGuQGFuAgdtbs5DQgQ9whjHzNcvQflZOve1hmTLSgE2jK6/fi68qTHZ1FJLrX7dnE3W+IbPUAEHAgKTbQ+z3IswszUcLsVFYjnpg=="}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:22:26.241115 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-af2f15b7-b6e0-4415-b94c-32e0cadaf25b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Getting quotas for project 7c95b871ff2b4ed89195a9c0fa94e8b4. Resources: {'key_pairs'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:22:26.245938 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-af2f15b7-b6e0-4415-b94c-32e0cadaf25b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Getting quotas for user 4bdaecd5dd5d461383878c4b96ef98be and project 7c95b871ff2b4ed89195a9c0fa94e8b4. Resources: {'key_pairs'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:22:26.370308 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-3966583c-a772-4a87-a6d2-d1aaf9c4d9e0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:26.371089 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-3966583c-a772-4a87-a6d2-d1aaf9c4d9e0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:26.378405 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3966583c-a772-4a87-a6d2-d1aaf9c4d9e0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:26.378896 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3966583c-a772-4a87-a6d2-d1aaf9c4d9e0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:26.379334 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3966583c-a772-4a87-a6d2-d1aaf9c4d9e0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:26.380100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3966583c-a772-4a87-a6d2-d1aaf9c4d9e0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:26.380560 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3966583c-a772-4a87-a6d2-d1aaf9c4d9e0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:26.380987 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3966583c-a772-4a87-a6d2-d1aaf9c4d9e0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:26.422478 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-af2f15b7-b6e0-4415-b94c-32e0cadaf25b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.372642 Sep 23 15:22:26.423282 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 142/270] 10.222.0.55 () {60 vars in 1159 bytes} [Fri Sep 23 15:22:26 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:22:26.455654 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-3966583c-a772-4a87-a6d2-d1aaf9c4d9e0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:26.463611 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-3966583c-a772-4a87-a6d2-d1aaf9c4d9e0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1249 microversion: 2.1 time: 0.099496 Sep 23 15:22:26.464382 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 129/271] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:26 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1249 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:22:26.636732 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b7c6da1c-d5cc-47f5-99c4-36c087c16c0a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:26.637349 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-b7c6da1c-d5cc-47f5-99c4-36c087c16c0a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:26.645774 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b7c6da1c-d5cc-47f5-99c4-36c087c16c0a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:26.647036 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b7c6da1c-d5cc-47f5-99c4-36c087c16c0a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:26.647633 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b7c6da1c-d5cc-47f5-99c4-36c087c16c0a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:26.648530 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b7c6da1c-d5cc-47f5-99c4-36c087c16c0a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:26.648933 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b7c6da1c-d5cc-47f5-99c4-36c087c16c0a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:26.649375 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b7c6da1c-d5cc-47f5-99c4-36c087c16c0a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:26.815450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-b7c6da1c-d5cc-47f5-99c4-36c087c16c0a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:26.824760 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-b7c6da1c-d5cc-47f5-99c4-36c087c16c0a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:26.826346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-b7c6da1c-d5cc-47f5-99c4-36c087c16c0a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:26.827520 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-b7c6da1c-d5cc-47f5-99c4-36c087c16c0a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1724 microversion: 2.20 time: 0.195262 Sep 23 15:22:26.846664 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 143/272] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:26 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:22:27.490032 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-e46c1535-d461-4572-bf26-99a90506ed26 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:27.490813 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-e46c1535-d461-4572-bf26-99a90506ed26 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:27.502347 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e46c1535-d461-4572-bf26-99a90506ed26 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:27.503013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e46c1535-d461-4572-bf26-99a90506ed26 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:27.503923 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e46c1535-d461-4572-bf26-99a90506ed26 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:27.505075 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e46c1535-d461-4572-bf26-99a90506ed26 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:27.505980 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e46c1535-d461-4572-bf26-99a90506ed26 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:27.506494 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e46c1535-d461-4572-bf26-99a90506ed26 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:27.728115 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-e46c1535-d461-4572-bf26-99a90506ed26 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:27.737000 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-e46c1535-d461-4572-bf26-99a90506ed26 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1241 microversion: 2.1 time: 0.251288 Sep 23 15:22:27.737584 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 130/273] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:27 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1241 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:27.855012 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-f2aa4df9-da71-4579-bf9d-b697c4ea5608 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:27.855624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-f2aa4df9-da71-4579-bf9d-b697c4ea5608 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:27.863585 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f2aa4df9-da71-4579-bf9d-b697c4ea5608 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:27.864344 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f2aa4df9-da71-4579-bf9d-b697c4ea5608 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:27.864988 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f2aa4df9-da71-4579-bf9d-b697c4ea5608 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:27.865701 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f2aa4df9-da71-4579-bf9d-b697c4ea5608 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:27.866198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f2aa4df9-da71-4579-bf9d-b697c4ea5608 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:27.866652 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f2aa4df9-da71-4579-bf9d-b697c4ea5608 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:28.055086 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-f2aa4df9-da71-4579-bf9d-b697c4ea5608 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:28.085391 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-f2aa4df9-da71-4579-bf9d-b697c4ea5608 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:28.086949 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-f2aa4df9-da71-4579-bf9d-b697c4ea5608 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:28.088283 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-f2aa4df9-da71-4579-bf9d-b697c4ea5608 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1724 microversion: 2.20 time: 0.237203 Sep 23 15:22:28.101575 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 144/274] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:27 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:22:28.778077 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-16b412bd-ba86-4e26-afc3-38ebf678d104 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:28.779338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-16b412bd-ba86-4e26-afc3-38ebf678d104 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:28.789136 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-16b412bd-ba86-4e26-afc3-38ebf678d104 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:28.790106 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-16b412bd-ba86-4e26-afc3-38ebf678d104 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:28.790728 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-16b412bd-ba86-4e26-afc3-38ebf678d104 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:28.792244 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-16b412bd-ba86-4e26-afc3-38ebf678d104 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:28.793020 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-16b412bd-ba86-4e26-afc3-38ebf678d104 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:28.794299 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-16b412bd-ba86-4e26-afc3-38ebf678d104 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:28.933464 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-16b412bd-ba86-4e26-afc3-38ebf678d104 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:28.934220 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-16b412bd-ba86-4e26-afc3-38ebf678d104 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1297 microversion: 2.1 time: 0.168550 Sep 23 15:22:28.947531 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 131/275] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:28 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1297 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:29.131007 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a659bfaa-6d59-4402-9eb8-992450d1b395 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:29.131761 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-a659bfaa-6d59-4402-9eb8-992450d1b395 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:29.145398 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a659bfaa-6d59-4402-9eb8-992450d1b395 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:29.146156 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a659bfaa-6d59-4402-9eb8-992450d1b395 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:29.146774 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a659bfaa-6d59-4402-9eb8-992450d1b395 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:29.147640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a659bfaa-6d59-4402-9eb8-992450d1b395 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:29.148269 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a659bfaa-6d59-4402-9eb8-992450d1b395 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:29.148837 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a659bfaa-6d59-4402-9eb8-992450d1b395 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:29.462789 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a659bfaa-6d59-4402-9eb8-992450d1b395 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:29.467046 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:29.473592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a659bfaa-6d59-4402-9eb8-992450d1b395 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:29.476077 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a659bfaa-6d59-4402-9eb8-992450d1b395 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:29.476985 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-a659bfaa-6d59-4402-9eb8-992450d1b395 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1724 microversion: 2.20 time: 0.350060 Sep 23 15:22:29.477549 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 145/276] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:29 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1724 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:22:29.962038 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-c2749fa8-b80d-4463-bade-f4d89062ed74 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:29.962719 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-c2749fa8-b80d-4463-bade-f4d89062ed74 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:29.969096 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c2749fa8-b80d-4463-bade-f4d89062ed74 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:29.969584 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c2749fa8-b80d-4463-bade-f4d89062ed74 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:29.970061 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c2749fa8-b80d-4463-bade-f4d89062ed74 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:29.970770 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c2749fa8-b80d-4463-bade-f4d89062ed74 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:29.971230 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c2749fa8-b80d-4463-bade-f4d89062ed74 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:29.971659 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c2749fa8-b80d-4463-bade-f4d89062ed74 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:30.044140 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-c2749fa8-b80d-4463-bade-f4d89062ed74 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:30.052111 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-c2749fa8-b80d-4463-bade-f4d89062ed74 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1315 microversion: 2.1 time: 0.094067 Sep 23 15:22:30.052682 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 132/277] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:29 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1315 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:22:30.504683 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-4c0f482a-c6c9-4c4a-93f1-6d513fd00bd5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:30.506617 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-4c0f482a-c6c9-4c4a-93f1-6d513fd00bd5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:30.517750 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4c0f482a-c6c9-4c4a-93f1-6d513fd00bd5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:30.523965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4c0f482a-c6c9-4c4a-93f1-6d513fd00bd5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:30.523965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4c0f482a-c6c9-4c4a-93f1-6d513fd00bd5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:30.523965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4c0f482a-c6c9-4c4a-93f1-6d513fd00bd5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:30.523965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4c0f482a-c6c9-4c4a-93f1-6d513fd00bd5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:30.524845 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4c0f482a-c6c9-4c4a-93f1-6d513fd00bd5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:30.816449 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-4c0f482a-c6c9-4c4a-93f1-6d513fd00bd5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:30.826666 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-4c0f482a-c6c9-4c4a-93f1-6d513fd00bd5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:30.828831 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-4c0f482a-c6c9-4c4a-93f1-6d513fd00bd5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:30.830135 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-4c0f482a-c6c9-4c4a-93f1-6d513fd00bd5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1724 microversion: 2.20 time: 0.331358 Sep 23 15:22:30.830811 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 146/278] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:30 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1724 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:22:31.080870 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-31f5dc18-63d1-4631-a5d0-9a9fcf39983a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:31.081818 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-31f5dc18-63d1-4631-a5d0-9a9fcf39983a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:31.090533 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-31f5dc18-63d1-4631-a5d0-9a9fcf39983a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:31.091204 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-31f5dc18-63d1-4631-a5d0-9a9fcf39983a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:31.091917 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-31f5dc18-63d1-4631-a5d0-9a9fcf39983a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:31.092976 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-31f5dc18-63d1-4631-a5d0-9a9fcf39983a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:31.094115 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-31f5dc18-63d1-4631-a5d0-9a9fcf39983a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:31.095586 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-31f5dc18-63d1-4631-a5d0-9a9fcf39983a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:31.270122 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-31f5dc18-63d1-4631-a5d0-9a9fcf39983a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:31.277950 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-31f5dc18-63d1-4631-a5d0-9a9fcf39983a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1371 microversion: 2.1 time: 0.204304 Sep 23 15:22:31.278520 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 133/279] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:31 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:31.860089 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-4a5ccb02-e442-4fa7-b8f4-e24da9f87e15 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:31.860601 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-4a5ccb02-e442-4fa7-b8f4-e24da9f87e15 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:31.867440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4a5ccb02-e442-4fa7-b8f4-e24da9f87e15 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:31.867923 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4a5ccb02-e442-4fa7-b8f4-e24da9f87e15 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:31.868384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4a5ccb02-e442-4fa7-b8f4-e24da9f87e15 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:31.872344 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4a5ccb02-e442-4fa7-b8f4-e24da9f87e15 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:31.872344 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4a5ccb02-e442-4fa7-b8f4-e24da9f87e15 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:31.872344 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4a5ccb02-e442-4fa7-b8f4-e24da9f87e15 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:32.039396 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-05b02521-dec3-453c-a69b-3dd3bfa8570f req-d5ba3635-79a5-48ec-93fb-f4711b7d4241 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d2de5a1-7ae9-4010-a7fc-5d2f45212418", "tag": "7d99929c-386a-4e5e-bc8f-6751a85b69b8"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:22:32.050917 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-05b02521-dec3-453c-a69b-3dd3bfa8570f req-d5ba3635-79a5-48ec-93fb-f4711b7d4241 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:32.051740 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-05b02521-dec3-453c-a69b-3dd3bfa8570f req-d5ba3635-79a5-48ec-93fb-f4711b7d4241 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:32.052354 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-05b02521-dec3-453c-a69b-3dd3bfa8570f req-d5ba3635-79a5-48ec-93fb-f4711b7d4241 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:32.070122 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-05b02521-dec3-453c-a69b-3dd3bfa8570f req-d5ba3635-79a5-48ec-93fb-f4711b7d4241 service nova] Creating event network-changed:7d99929c-386a-4e5e-bc8f-6751a85b69b8 for instance 7d2de5a1-7ae9-4010-a7fc-5d2f45212418 on hv-cinder-85530 Sep 23 15:22:32.075971 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-05b02521-dec3-453c-a69b-3dd3bfa8570f req-d5ba3635-79a5-48ec-93fb-f4711b7d4241 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039883 Sep 23 15:22:32.076794 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 134/280] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:22:32.077111 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-4a5ccb02-e442-4fa7-b8f4-e24da9f87e15 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:32.088218 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-4a5ccb02-e442-4fa7-b8f4-e24da9f87e15 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:32.089808 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-4a5ccb02-e442-4fa7-b8f4-e24da9f87e15 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:32.090995 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-4a5ccb02-e442-4fa7-b8f4-e24da9f87e15 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1724 microversion: 2.20 time: 0.236288 Sep 23 15:22:32.092597 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 147/281] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:31 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:22:32.323686 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-1e7d452b-79a3-4434-84f9-4845b06760eb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:32.325183 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-1e7d452b-79a3-4434-84f9-4845b06760eb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:32.332979 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1e7d452b-79a3-4434-84f9-4845b06760eb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:32.333687 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1e7d452b-79a3-4434-84f9-4845b06760eb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:32.334309 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1e7d452b-79a3-4434-84f9-4845b06760eb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:32.335172 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1e7d452b-79a3-4434-84f9-4845b06760eb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:32.335780 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1e7d452b-79a3-4434-84f9-4845b06760eb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:32.336489 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1e7d452b-79a3-4434-84f9-4845b06760eb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:32.516160 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-1e7d452b-79a3-4434-84f9-4845b06760eb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:32.524899 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-1e7d452b-79a3-4434-84f9-4845b06760eb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1371 microversion: 2.1 time: 0.225865 Sep 23 15:22:32.525485 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 135/282] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:32 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1371 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:33.121259 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a46d330d-1107-413b-9e3f-d843edf195fa tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:33.121866 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-a46d330d-1107-413b-9e3f-d843edf195fa tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:33.130177 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a46d330d-1107-413b-9e3f-d843edf195fa tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:33.130694 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a46d330d-1107-413b-9e3f-d843edf195fa tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:33.131198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a46d330d-1107-413b-9e3f-d843edf195fa tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:33.131862 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a46d330d-1107-413b-9e3f-d843edf195fa tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:33.132381 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a46d330d-1107-413b-9e3f-d843edf195fa tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:33.132860 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a46d330d-1107-413b-9e3f-d843edf195fa tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:33.282851 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a46d330d-1107-413b-9e3f-d843edf195fa tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:33.294770 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a46d330d-1107-413b-9e3f-d843edf195fa tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:33.296614 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a46d330d-1107-413b-9e3f-d843edf195fa tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:33.300316 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-a46d330d-1107-413b-9e3f-d843edf195fa tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1724 microversion: 2.20 time: 0.182964 Sep 23 15:22:33.300907 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 148/283] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:33 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:22:33.549702 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-0ffdbfed-daad-4d9f-b425-e42bb8456451 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:33.550921 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-0ffdbfed-daad-4d9f-b425-e42bb8456451 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:33.553232 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell0:SELECT=2 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:33.554310 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell0:SELECT=6 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:33.559805 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0ffdbfed-daad-4d9f-b425-e42bb8456451 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:33.560402 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0ffdbfed-daad-4d9f-b425-e42bb8456451 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:33.560913 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0ffdbfed-daad-4d9f-b425-e42bb8456451 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:33.561689 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0ffdbfed-daad-4d9f-b425-e42bb8456451 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:33.562746 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0ffdbfed-daad-4d9f-b425-e42bb8456451 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:33.563244 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0ffdbfed-daad-4d9f-b425-e42bb8456451 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:33.584626 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:33.712709 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-0ffdbfed-daad-4d9f-b425-e42bb8456451 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:33.721624 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-0ffdbfed-daad-4d9f-b425-e42bb8456451 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1371 microversion: 2.1 time: 0.175957 Sep 23 15:22:33.722490 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 136/284] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:33 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:34.328578 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-1a2bac6f-f74c-48ed-8f32-8ce937e01593 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:34.329131 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-1a2bac6f-f74c-48ed-8f32-8ce937e01593 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:34.335380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1a2bac6f-f74c-48ed-8f32-8ce937e01593 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:34.335867 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1a2bac6f-f74c-48ed-8f32-8ce937e01593 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:34.336332 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1a2bac6f-f74c-48ed-8f32-8ce937e01593 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:34.337025 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1a2bac6f-f74c-48ed-8f32-8ce937e01593 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:34.337517 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1a2bac6f-f74c-48ed-8f32-8ce937e01593 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:34.337939 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1a2bac6f-f74c-48ed-8f32-8ce937e01593 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:34.487837 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-1a2bac6f-f74c-48ed-8f32-8ce937e01593 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:34.497564 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-1a2bac6f-f74c-48ed-8f32-8ce937e01593 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:34.504252 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-1a2bac6f-f74c-48ed-8f32-8ce937e01593 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:34.505742 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-1a2bac6f-f74c-48ed-8f32-8ce937e01593 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1724 microversion: 2.20 time: 0.182016 Sep 23 15:22:34.506305 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 149/285] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:34 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:22:34.744744 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-bde5ed71-3449-49b8-a6a2-f0a95b777398 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:34.753952 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-bde5ed71-3449-49b8-a6a2-f0a95b777398 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:34.753952 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bde5ed71-3449-49b8-a6a2-f0a95b777398 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:34.753952 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bde5ed71-3449-49b8-a6a2-f0a95b777398 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:34.753952 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bde5ed71-3449-49b8-a6a2-f0a95b777398 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:34.754667 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bde5ed71-3449-49b8-a6a2-f0a95b777398 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:34.754667 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bde5ed71-3449-49b8-a6a2-f0a95b777398 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:34.754667 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bde5ed71-3449-49b8-a6a2-f0a95b777398 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:34.897229 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-bde5ed71-3449-49b8-a6a2-f0a95b777398 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:34.905407 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-bde5ed71-3449-49b8-a6a2-f0a95b777398 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1371 microversion: 2.1 time: 0.164414 Sep 23 15:22:34.907073 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 137/286] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:34 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:22:35.533031 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-4fe3c085-597e-49fe-a77d-ebf6a45609e4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:35.534384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-4fe3c085-597e-49fe-a77d-ebf6a45609e4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:35.541753 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4fe3c085-597e-49fe-a77d-ebf6a45609e4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:35.542247 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4fe3c085-597e-49fe-a77d-ebf6a45609e4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:35.542916 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4fe3c085-597e-49fe-a77d-ebf6a45609e4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:35.543902 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4fe3c085-597e-49fe-a77d-ebf6a45609e4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:35.544398 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4fe3c085-597e-49fe-a77d-ebf6a45609e4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:35.545532 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4fe3c085-597e-49fe-a77d-ebf6a45609e4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:35.699110 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-4fe3c085-597e-49fe-a77d-ebf6a45609e4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:35.708011 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-4fe3c085-597e-49fe-a77d-ebf6a45609e4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:35.709507 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-4fe3c085-597e-49fe-a77d-ebf6a45609e4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:35.710673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-4fe3c085-597e-49fe-a77d-ebf6a45609e4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1724 microversion: 2.20 time: 0.183204 Sep 23 15:22:35.712012 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 150/287] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:35 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:22:35.933314 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-4bcda71c-14ad-48fb-afcb-fe5a75442330 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:35.934496 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-4bcda71c-14ad-48fb-afcb-fe5a75442330 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:35.946018 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4bcda71c-14ad-48fb-afcb-fe5a75442330 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:35.956783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4bcda71c-14ad-48fb-afcb-fe5a75442330 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:35.956783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4bcda71c-14ad-48fb-afcb-fe5a75442330 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:35.956783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4bcda71c-14ad-48fb-afcb-fe5a75442330 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:35.956783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4bcda71c-14ad-48fb-afcb-fe5a75442330 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:35.957333 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4bcda71c-14ad-48fb-afcb-fe5a75442330 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:36.099689 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-4bcda71c-14ad-48fb-afcb-fe5a75442330 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:36.107351 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-4bcda71c-14ad-48fb-afcb-fe5a75442330 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1371 microversion: 2.1 time: 0.180824 Sep 23 15:22:36.107967 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 138/288] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:35 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:36.484532 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-034128ce-b605-43a2-b7bb-21721f439f07 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:22:36.490496 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell0:SELECT=10 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:36.494513 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-034128ce-b605-43a2-b7bb-21721f439f07 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:36.494513 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-034128ce-b605-43a2-b7bb-21721f439f07 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:36.494513 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-034128ce-b605-43a2-b7bb-21721f439f07 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:36.560962 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-034128ce-b605-43a2-b7bb-21721f439f07 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Going to try to stop instance {{(pid=121450) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 15:22:36.741850 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-3c7df507-a7f2-4a6b-b53e-10ab90394f36 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:36.741850 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-3c7df507-a7f2-4a6b-b53e-10ab90394f36 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:36.747546 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3c7df507-a7f2-4a6b-b53e-10ab90394f36 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:36.748126 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3c7df507-a7f2-4a6b-b53e-10ab90394f36 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:36.748520 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-034128ce-b605-43a2-b7bb-21721f439f07 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "POST /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f/action" status: 202 len: 0 microversion: 2.1 time: 0.268319 Sep 23 15:22:36.748638 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3c7df507-a7f2-4a6b-b53e-10ab90394f36 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:36.752558 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 151/289] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Sep 23 15:22:36 2022] POST /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:22:36.752940 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3c7df507-a7f2-4a6b-b53e-10ab90394f36 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:36.753424 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3c7df507-a7f2-4a6b-b53e-10ab90394f36 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:36.754046 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3c7df507-a7f2-4a6b-b53e-10ab90394f36 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:36.762755 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-7cb64ead-cbda-4f44-aef8-0e45bced47e8 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:36.763593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-7cb64ead-cbda-4f44-aef8-0e45bced47e8 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:36.771589 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7cb64ead-cbda-4f44-aef8-0e45bced47e8 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:36.772290 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7cb64ead-cbda-4f44-aef8-0e45bced47e8 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:36.773042 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7cb64ead-cbda-4f44-aef8-0e45bced47e8 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:36.774183 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7cb64ead-cbda-4f44-aef8-0e45bced47e8 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:36.774939 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7cb64ead-cbda-4f44-aef8-0e45bced47e8 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:36.775513 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7cb64ead-cbda-4f44-aef8-0e45bced47e8 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:36.931829 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-3c7df507-a7f2-4a6b-b53e-10ab90394f36 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:36.940811 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-3c7df507-a7f2-4a6b-b53e-10ab90394f36 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:36.943174 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-3c7df507-a7f2-4a6b-b53e-10ab90394f36 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:36.944447 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-3c7df507-a7f2-4a6b-b53e-10ab90394f36 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1724 microversion: 2.20 time: 0.207925 Sep 23 15:22:36.945338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 139/290] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:36 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:22:36.946674 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-7cb64ead-cbda-4f44-aef8-0e45bced47e8 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:36.957149 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-7cb64ead-cbda-4f44-aef8-0e45bced47e8 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1722 microversion: 2.1 time: 0.203027 Sep 23 15:22:36.957718 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 152/291] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:36 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:37.130531 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-67ce47ad-eff9-447d-b88c-58c04eab8566 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:37.131490 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-67ce47ad-eff9-447d-b88c-58c04eab8566 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:37.138500 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-67ce47ad-eff9-447d-b88c-58c04eab8566 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:37.138910 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-67ce47ad-eff9-447d-b88c-58c04eab8566 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:37.139342 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-67ce47ad-eff9-447d-b88c-58c04eab8566 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:37.140603 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-67ce47ad-eff9-447d-b88c-58c04eab8566 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:37.141056 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-67ce47ad-eff9-447d-b88c-58c04eab8566 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:37.141499 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-67ce47ad-eff9-447d-b88c-58c04eab8566 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:37.284654 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-67ce47ad-eff9-447d-b88c-58c04eab8566 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:37.293155 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-67ce47ad-eff9-447d-b88c-58c04eab8566 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1371 microversion: 2.1 time: 0.166666 Sep 23 15:22:37.293850 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 140/292] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:37 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:37.972904 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-fe2a12ef-2124-4ed1-b807-06c48bad934c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:37.973592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-fe2a12ef-2124-4ed1-b807-06c48bad934c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:37.980568 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fe2a12ef-2124-4ed1-b807-06c48bad934c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:37.981055 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fe2a12ef-2124-4ed1-b807-06c48bad934c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:37.981271 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fe2a12ef-2124-4ed1-b807-06c48bad934c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:37.982203 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fe2a12ef-2124-4ed1-b807-06c48bad934c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:37.982419 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fe2a12ef-2124-4ed1-b807-06c48bad934c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:37.982845 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fe2a12ef-2124-4ed1-b807-06c48bad934c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:37.988577 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-c174d3ce-5b59-4611-b74f-f2697c471c9d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:37.990043 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-c174d3ce-5b59-4611-b74f-f2697c471c9d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:37.996934 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:37.998601 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c174d3ce-5b59-4611-b74f-f2697c471c9d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:37.999607 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c174d3ce-5b59-4611-b74f-f2697c471c9d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:38.000909 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c174d3ce-5b59-4611-b74f-f2697c471c9d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:38.001698 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c174d3ce-5b59-4611-b74f-f2697c471c9d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:38.002613 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c174d3ce-5b59-4611-b74f-f2697c471c9d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:38.003766 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c174d3ce-5b59-4611-b74f-f2697c471c9d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:38.130958 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-fe2a12ef-2124-4ed1-b807-06c48bad934c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:38.145263 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-fe2a12ef-2124-4ed1-b807-06c48bad934c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:38.146896 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-fe2a12ef-2124-4ed1-b807-06c48bad934c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:38.148128 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-fe2a12ef-2124-4ed1-b807-06c48bad934c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1724 microversion: 2.20 time: 0.179528 Sep 23 15:22:38.148692 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 153/293] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:37 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:22:38.149522 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-c174d3ce-5b59-4611-b74f-f2697c471c9d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:38.160299 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-c174d3ce-5b59-4611-b74f-f2697c471c9d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1722 microversion: 2.1 time: 0.176956 Sep 23 15:22:38.160868 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 141/294] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:37 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:38.324530 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a476ea3b-c068-4245-8cc9-19f95ca73a8f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:38.325142 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-a476ea3b-c068-4245-8cc9-19f95ca73a8f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:38.331722 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a476ea3b-c068-4245-8cc9-19f95ca73a8f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:38.332482 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a476ea3b-c068-4245-8cc9-19f95ca73a8f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:38.332917 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a476ea3b-c068-4245-8cc9-19f95ca73a8f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:38.333788 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a476ea3b-c068-4245-8cc9-19f95ca73a8f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:38.334246 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a476ea3b-c068-4245-8cc9-19f95ca73a8f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:38.334665 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a476ea3b-c068-4245-8cc9-19f95ca73a8f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:38.472290 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a476ea3b-c068-4245-8cc9-19f95ca73a8f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:38.480361 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-a476ea3b-c068-4245-8cc9-19f95ca73a8f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1371 microversion: 2.1 time: 0.159748 Sep 23 15:22:38.480897 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 154/295] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:38 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:39.175075 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-bf90cecc-be27-46a7-a25a-9b3733ab9e6a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:39.175688 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-bf90cecc-be27-46a7-a25a-9b3733ab9e6a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:39.182299 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf90cecc-be27-46a7-a25a-9b3733ab9e6a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:39.183037 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf90cecc-be27-46a7-a25a-9b3733ab9e6a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:39.183733 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf90cecc-be27-46a7-a25a-9b3733ab9e6a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:39.187747 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf90cecc-be27-46a7-a25a-9b3733ab9e6a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:39.187747 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf90cecc-be27-46a7-a25a-9b3733ab9e6a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:39.187747 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf90cecc-be27-46a7-a25a-9b3733ab9e6a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:39.192604 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-3afba331-31f9-445f-b669-dcb2842873f3 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:39.193268 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-3afba331-31f9-445f-b669-dcb2842873f3 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:39.205779 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3afba331-31f9-445f-b669-dcb2842873f3 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:39.206273 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3afba331-31f9-445f-b669-dcb2842873f3 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:39.206709 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3afba331-31f9-445f-b669-dcb2842873f3 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:39.207413 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3afba331-31f9-445f-b669-dcb2842873f3 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:39.207865 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3afba331-31f9-445f-b669-dcb2842873f3 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:39.210530 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3afba331-31f9-445f-b669-dcb2842873f3 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:39.357736 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-3afba331-31f9-445f-b669-dcb2842873f3 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:39.369095 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-3afba331-31f9-445f-b669-dcb2842873f3 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1722 microversion: 2.1 time: 0.187155 Sep 23 15:22:39.370264 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 155/296] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:39 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:39.383038 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-bf90cecc-be27-46a7-a25a-9b3733ab9e6a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:39.391456 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-bf90cecc-be27-46a7-a25a-9b3733ab9e6a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:39.393033 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-bf90cecc-be27-46a7-a25a-9b3733ab9e6a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:39.394307 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-bf90cecc-be27-46a7-a25a-9b3733ab9e6a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1724 microversion: 2.20 time: 0.224374 Sep 23 15:22:39.394961 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 142/297] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:39 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:22:39.504289 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-87da559c-70f7-447b-8684-db0bb72dc68f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:39.504900 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-87da559c-70f7-447b-8684-db0bb72dc68f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:39.536954 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-87da559c-70f7-447b-8684-db0bb72dc68f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:39.537467 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-87da559c-70f7-447b-8684-db0bb72dc68f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:39.537907 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-87da559c-70f7-447b-8684-db0bb72dc68f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:39.538623 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-87da559c-70f7-447b-8684-db0bb72dc68f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:39.539077 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-87da559c-70f7-447b-8684-db0bb72dc68f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:39.548127 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-87da559c-70f7-447b-8684-db0bb72dc68f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:39.708691 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-87da559c-70f7-447b-8684-db0bb72dc68f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:39.717450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-87da559c-70f7-447b-8684-db0bb72dc68f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1371 microversion: 2.1 time: 0.216889 Sep 23 15:22:39.719471 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 156/298] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:39 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1371 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:39.841651 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-682d3097-d33a-44de-a049-7e869a4a80e4 req-a32bd27b-4c28-446f-95cd-b00c8e0c2b1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d2de5a1-7ae9-4010-a7fc-5d2f45212418", "name": "network-vif-plugged", "status": "completed", "tag": "7d99929c-386a-4e5e-bc8f-6751a85b69b8"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:22:39.853669 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-682d3097-d33a-44de-a049-7e869a4a80e4 req-a32bd27b-4c28-446f-95cd-b00c8e0c2b1c service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:39.871739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-682d3097-d33a-44de-a049-7e869a4a80e4 req-a32bd27b-4c28-446f-95cd-b00c8e0c2b1c service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:39.871739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-682d3097-d33a-44de-a049-7e869a4a80e4 req-a32bd27b-4c28-446f-95cd-b00c8e0c2b1c service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:39.871739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-682d3097-d33a-44de-a049-7e869a4a80e4 req-a32bd27b-4c28-446f-95cd-b00c8e0c2b1c service nova] Creating event network-vif-plugged:7d99929c-386a-4e5e-bc8f-6751a85b69b8 for instance 7d2de5a1-7ae9-4010-a7fc-5d2f45212418 on hv-cinder-85530 Sep 23 15:22:39.872091 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-682d3097-d33a-44de-a049-7e869a4a80e4 req-a32bd27b-4c28-446f-95cd-b00c8e0c2b1c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034300 Sep 23 15:22:39.872483 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 143/299] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:22:40.400841 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-e69bb04c-4e9b-461b-939b-c833382b8786 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:40.400841 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-e69bb04c-4e9b-461b-939b-c833382b8786 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:40.407119 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e69bb04c-4e9b-461b-939b-c833382b8786 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:40.407119 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e69bb04c-4e9b-461b-939b-c833382b8786 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:40.407119 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e69bb04c-4e9b-461b-939b-c833382b8786 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:40.407119 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e69bb04c-4e9b-461b-939b-c833382b8786 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:40.407479 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e69bb04c-4e9b-461b-939b-c833382b8786 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:40.407479 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e69bb04c-4e9b-461b-939b-c833382b8786 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:40.420162 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-852b7e6f-ae6c-4b8c-8dfc-64bbdd5b666c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:40.422850 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-852b7e6f-ae6c-4b8c-8dfc-64bbdd5b666c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:40.443045 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-852b7e6f-ae6c-4b8c-8dfc-64bbdd5b666c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:40.444373 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-852b7e6f-ae6c-4b8c-8dfc-64bbdd5b666c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:40.445091 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-852b7e6f-ae6c-4b8c-8dfc-64bbdd5b666c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:40.446161 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-852b7e6f-ae6c-4b8c-8dfc-64bbdd5b666c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:40.447042 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-852b7e6f-ae6c-4b8c-8dfc-64bbdd5b666c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:40.448029 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-852b7e6f-ae6c-4b8c-8dfc-64bbdd5b666c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:40.689708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-e69bb04c-4e9b-461b-939b-c833382b8786 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:40.698555 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-e69bb04c-4e9b-461b-939b-c833382b8786 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1722 microversion: 2.1 time: 0.308290 Sep 23 15:22:40.699062 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 157/300] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:40 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1722 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:40.742813 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-edcf8b5c-67ca-4bc3-b6a9-9f6002a4efb1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:40.743665 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-edcf8b5c-67ca-4bc3-b6a9-9f6002a4efb1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:40.750951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-edcf8b5c-67ca-4bc3-b6a9-9f6002a4efb1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:40.751440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-edcf8b5c-67ca-4bc3-b6a9-9f6002a4efb1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:40.751881 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-edcf8b5c-67ca-4bc3-b6a9-9f6002a4efb1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:40.752607 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-edcf8b5c-67ca-4bc3-b6a9-9f6002a4efb1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:40.753064 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-edcf8b5c-67ca-4bc3-b6a9-9f6002a4efb1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:40.753640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-edcf8b5c-67ca-4bc3-b6a9-9f6002a4efb1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:40.758420 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-852b7e6f-ae6c-4b8c-8dfc-64bbdd5b666c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:40.767136 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-852b7e6f-ae6c-4b8c-8dfc-64bbdd5b666c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:40.768744 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-852b7e6f-ae6c-4b8c-8dfc-64bbdd5b666c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:40.769961 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-852b7e6f-ae6c-4b8c-8dfc-64bbdd5b666c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1724 microversion: 2.20 time: 0.354873 Sep 23 15:22:40.771564 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 144/301] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:40 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1724 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:22:40.904925 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-edcf8b5c-67ca-4bc3-b6a9-9f6002a4efb1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:40.918952 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-edcf8b5c-67ca-4bc3-b6a9-9f6002a4efb1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1371 microversion: 2.1 time: 0.180085 Sep 23 15:22:40.923015 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 158/302] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:40 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:41.723774 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-fa1e9faf-ddda-4c34-88da-bc7e625c6713 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:41.724418 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-fa1e9faf-ddda-4c34-88da-bc7e625c6713 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:41.730235 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fa1e9faf-ddda-4c34-88da-bc7e625c6713 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:41.730908 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fa1e9faf-ddda-4c34-88da-bc7e625c6713 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:41.731354 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fa1e9faf-ddda-4c34-88da-bc7e625c6713 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:41.732074 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fa1e9faf-ddda-4c34-88da-bc7e625c6713 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:41.732546 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fa1e9faf-ddda-4c34-88da-bc7e625c6713 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:41.732972 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fa1e9faf-ddda-4c34-88da-bc7e625c6713 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:41.795019 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-cbd92436-1c84-44a1-991f-46b8f70b67f4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:41.795763 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-cbd92436-1c84-44a1-991f-46b8f70b67f4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:41.804252 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cbd92436-1c84-44a1-991f-46b8f70b67f4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:41.804735 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cbd92436-1c84-44a1-991f-46b8f70b67f4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:41.805240 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cbd92436-1c84-44a1-991f-46b8f70b67f4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:41.805918 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cbd92436-1c84-44a1-991f-46b8f70b67f4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:41.806372 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cbd92436-1c84-44a1-991f-46b8f70b67f4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:41.806781 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cbd92436-1c84-44a1-991f-46b8f70b67f4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:41.877916 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-fa1e9faf-ddda-4c34-88da-bc7e625c6713 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:41.889590 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-fa1e9faf-ddda-4c34-88da-bc7e625c6713 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1722 microversion: 2.1 time: 0.170040 Sep 23 15:22:41.890333 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 145/303] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:41 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:41.944215 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-62259310-913a-4f5c-999a-e364a5640f11 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:41.944823 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-62259310-913a-4f5c-999a-e364a5640f11 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:41.949635 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-cbd92436-1c84-44a1-991f-46b8f70b67f4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:41.950824 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-62259310-913a-4f5c-999a-e364a5640f11 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:41.951339 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-62259310-913a-4f5c-999a-e364a5640f11 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:41.951763 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-62259310-913a-4f5c-999a-e364a5640f11 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:41.952623 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-62259310-913a-4f5c-999a-e364a5640f11 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:41.953100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-62259310-913a-4f5c-999a-e364a5640f11 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:41.953537 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-62259310-913a-4f5c-999a-e364a5640f11 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:41.958426 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-cbd92436-1c84-44a1-991f-46b8f70b67f4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:41.960303 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-cbd92436-1c84-44a1-991f-46b8f70b67f4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:41.961528 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-cbd92436-1c84-44a1-991f-46b8f70b67f4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1724 microversion: 2.20 time: 0.170746 Sep 23 15:22:41.962156 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 159/304] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:41 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:22:42.094653 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-62259310-913a-4f5c-999a-e364a5640f11 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:42.102468 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-62259310-913a-4f5c-999a-e364a5640f11 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1371 microversion: 2.1 time: 0.162487 Sep 23 15:22:42.103036 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 146/305] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:41 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:22:42.914056 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-82b3f470-f9e6-472b-81ad-7b17b2aeae3a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:42.914615 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-82b3f470-f9e6-472b-81ad-7b17b2aeae3a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:42.921448 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-82b3f470-f9e6-472b-81ad-7b17b2aeae3a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:42.923336 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-82b3f470-f9e6-472b-81ad-7b17b2aeae3a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:42.923336 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-82b3f470-f9e6-472b-81ad-7b17b2aeae3a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:42.923336 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-82b3f470-f9e6-472b-81ad-7b17b2aeae3a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:42.924177 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-82b3f470-f9e6-472b-81ad-7b17b2aeae3a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:42.924177 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-82b3f470-f9e6-472b-81ad-7b17b2aeae3a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:42.988307 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-10b6373d-f963-48e6-914f-181b9c639a6b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:42.988948 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-10b6373d-f963-48e6-914f-181b9c639a6b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:42.995060 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-10b6373d-f963-48e6-914f-181b9c639a6b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:42.995547 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-10b6373d-f963-48e6-914f-181b9c639a6b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:42.996021 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-10b6373d-f963-48e6-914f-181b9c639a6b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:42.996732 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-10b6373d-f963-48e6-914f-181b9c639a6b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:42.997187 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-10b6373d-f963-48e6-914f-181b9c639a6b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:42.997611 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-10b6373d-f963-48e6-914f-181b9c639a6b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:43.064470 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-82b3f470-f9e6-472b-81ad-7b17b2aeae3a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:43.076296 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-82b3f470-f9e6-472b-81ad-7b17b2aeae3a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1722 microversion: 2.1 time: 0.165995 Sep 23 15:22:43.078192 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 160/306] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:42 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:43.126930 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-24169faa-d144-4cb8-ab67-c1caee46fe77 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:43.127546 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-24169faa-d144-4cb8-ab67-c1caee46fe77 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:43.134088 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-24169faa-d144-4cb8-ab67-c1caee46fe77 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:43.134578 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-24169faa-d144-4cb8-ab67-c1caee46fe77 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:43.135018 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-24169faa-d144-4cb8-ab67-c1caee46fe77 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:43.135715 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-24169faa-d144-4cb8-ab67-c1caee46fe77 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:43.136212 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-24169faa-d144-4cb8-ab67-c1caee46fe77 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:43.136875 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-24169faa-d144-4cb8-ab67-c1caee46fe77 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:43.158427 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-10b6373d-f963-48e6-914f-181b9c639a6b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:43.160813 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:43.171449 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-10b6373d-f963-48e6-914f-181b9c639a6b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:43.172880 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-10b6373d-f963-48e6-914f-181b9c639a6b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:43.174053 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-10b6373d-f963-48e6-914f-181b9c639a6b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1724 microversion: 2.20 time: 0.189870 Sep 23 15:22:43.174617 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 147/307] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:42 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:22:43.277948 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-24169faa-d144-4cb8-ab67-c1caee46fe77 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:43.286341 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-24169faa-d144-4cb8-ab67-c1caee46fe77 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1566 microversion: 2.1 time: 0.163771 Sep 23 15:22:43.286905 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 161/308] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:43 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:22:43.308920 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-afdb1ccc-a70b-44b1-be2e-ec7c19d2bfcc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:43.309413 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-afdb1ccc-a70b-44b1-be2e-ec7c19d2bfcc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:43.316345 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-afdb1ccc-a70b-44b1-be2e-ec7c19d2bfcc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:43.316841 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-afdb1ccc-a70b-44b1-be2e-ec7c19d2bfcc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:43.317279 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-afdb1ccc-a70b-44b1-be2e-ec7c19d2bfcc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:43.317973 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-afdb1ccc-a70b-44b1-be2e-ec7c19d2bfcc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:43.318437 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-afdb1ccc-a70b-44b1-be2e-ec7c19d2bfcc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:43.318871 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-afdb1ccc-a70b-44b1-be2e-ec7c19d2bfcc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:43.466357 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-afdb1ccc-a70b-44b1-be2e-ec7c19d2bfcc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.161417 Sep 23 15:22:43.466974 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 148/309] 10.222.0.55 () {58 vars in 1275 bytes} [Fri Sep 23 15:22:43 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/os-interface => generated 285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:22:44.103255 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-c31ad879-422d-4c1f-9515-25304d8331dd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:44.104217 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-c31ad879-422d-4c1f-9515-25304d8331dd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:44.113127 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c31ad879-422d-4c1f-9515-25304d8331dd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:44.114042 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c31ad879-422d-4c1f-9515-25304d8331dd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:44.114555 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c31ad879-422d-4c1f-9515-25304d8331dd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:44.115389 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c31ad879-422d-4c1f-9515-25304d8331dd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:44.115907 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c31ad879-422d-4c1f-9515-25304d8331dd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:44.116422 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c31ad879-422d-4c1f-9515-25304d8331dd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:44.200138 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-92e38d26-cce2-4aac-b799-2be71b2792b3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:44.200752 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-92e38d26-cce2-4aac-b799-2be71b2792b3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:44.209308 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-92e38d26-cce2-4aac-b799-2be71b2792b3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:44.209849 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-92e38d26-cce2-4aac-b799-2be71b2792b3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:44.210342 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-92e38d26-cce2-4aac-b799-2be71b2792b3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:44.211575 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-92e38d26-cce2-4aac-b799-2be71b2792b3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:44.212068 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-92e38d26-cce2-4aac-b799-2be71b2792b3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:44.212700 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-92e38d26-cce2-4aac-b799-2be71b2792b3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:44.379286 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-92e38d26-cce2-4aac-b799-2be71b2792b3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:44.388425 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-92e38d26-cce2-4aac-b799-2be71b2792b3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:44.397308 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-92e38d26-cce2-4aac-b799-2be71b2792b3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:44.400178 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-92e38d26-cce2-4aac-b799-2be71b2792b3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1724 microversion: 2.20 time: 0.204733 Sep 23 15:22:44.403235 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 149/310] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:44 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:22:44.523697 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-c31ad879-422d-4c1f-9515-25304d8331dd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:44.538736 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-c31ad879-422d-4c1f-9515-25304d8331dd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1722 microversion: 2.1 time: 0.435678 Sep 23 15:22:44.538736 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 162/311] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:44 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1722 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:44.611187 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-00ce6b85-1561-40d9-9cbf-320ce8fb52ff tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1078684553", "imageRef": "051c4746-7f50-4edb-b09d-a8935df360de", "flavorRef": "452", "networks": [{"uuid": "5d0889b4-33f0-4d83-abe3-fa2925a19a90"}]}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:22:45.197202 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-2a917b79-0dce-4574-b6d7-f1a5b1a26150 req-815f6fbe-d2ea-495b-a286-be4f691f71c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d2de5a1-7ae9-4010-a7fc-5d2f45212418", "tag": "7d99929c-386a-4e5e-bc8f-6751a85b69b8"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:22:45.208649 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-2a917b79-0dce-4574-b6d7-f1a5b1a26150 req-815f6fbe-d2ea-495b-a286-be4f691f71c4 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:45.209218 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-2a917b79-0dce-4574-b6d7-f1a5b1a26150 req-815f6fbe-d2ea-495b-a286-be4f691f71c4 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:45.209654 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-2a917b79-0dce-4574-b6d7-f1a5b1a26150 req-815f6fbe-d2ea-495b-a286-be4f691f71c4 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:45.231382 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-2a917b79-0dce-4574-b6d7-f1a5b1a26150 req-815f6fbe-d2ea-495b-a286-be4f691f71c4 service nova] Creating event network-changed:7d99929c-386a-4e5e-bc8f-6751a85b69b8 for instance 7d2de5a1-7ae9-4010-a7fc-5d2f45212418 on hv-cinder-85530 Sep 23 15:22:45.237561 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-2a917b79-0dce-4574-b6d7-f1a5b1a26150 req-815f6fbe-d2ea-495b-a286-be4f691f71c4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044082 Sep 23 15:22:45.238544 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 163/312] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:22:45.439310 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-08fc66e4-27db-4e0a-89fe-1f6e2f7f1f15 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:45.440338 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-08fc66e4-27db-4e0a-89fe-1f6e2f7f1f15 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:45.446456 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-08fc66e4-27db-4e0a-89fe-1f6e2f7f1f15 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:45.449587 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-08fc66e4-27db-4e0a-89fe-1f6e2f7f1f15 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:45.449587 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-08fc66e4-27db-4e0a-89fe-1f6e2f7f1f15 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:45.449587 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-08fc66e4-27db-4e0a-89fe-1f6e2f7f1f15 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:45.449587 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-08fc66e4-27db-4e0a-89fe-1f6e2f7f1f15 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:45.449967 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-08fc66e4-27db-4e0a-89fe-1f6e2f7f1f15 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:45.591591 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-08fc66e4-27db-4e0a-89fe-1f6e2f7f1f15 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:45.600879 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-08fc66e4-27db-4e0a-89fe-1f6e2f7f1f15 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:45.616007 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-08fc66e4-27db-4e0a-89fe-1f6e2f7f1f15 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:45.616007 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-08fc66e4-27db-4e0a-89fe-1f6e2f7f1f15 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1724 microversion: 2.20 time: 0.169766 Sep 23 15:22:45.616007 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 164/313] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:45 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:22:45.621344 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-1703b651-b6bf-4375-a70f-b73572ae43fa tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:45.622671 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-1703b651-b6bf-4375-a70f-b73572ae43fa tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:45.630597 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1703b651-b6bf-4375-a70f-b73572ae43fa tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:45.633272 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1703b651-b6bf-4375-a70f-b73572ae43fa tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:45.633976 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1703b651-b6bf-4375-a70f-b73572ae43fa tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:45.635195 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1703b651-b6bf-4375-a70f-b73572ae43fa tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:45.636026 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1703b651-b6bf-4375-a70f-b73572ae43fa tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:45.636526 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1703b651-b6bf-4375-a70f-b73572ae43fa tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:45.786692 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-1703b651-b6bf-4375-a70f-b73572ae43fa tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:45.796081 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-1703b651-b6bf-4375-a70f-b73572ae43fa tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1722 microversion: 2.1 time: 0.189884 Sep 23 15:22:45.796930 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 165/314] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:45 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:46.635146 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-4ed3cb9e-32ae-4603-a4f4-fb374f1fdb99 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:46.635800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-4ed3cb9e-32ae-4603-a4f4-fb374f1fdb99 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:46.642986 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4ed3cb9e-32ae-4603-a4f4-fb374f1fdb99 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:46.643465 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4ed3cb9e-32ae-4603-a4f4-fb374f1fdb99 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:46.643898 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4ed3cb9e-32ae-4603-a4f4-fb374f1fdb99 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:46.644615 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4ed3cb9e-32ae-4603-a4f4-fb374f1fdb99 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:46.645135 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4ed3cb9e-32ae-4603-a4f4-fb374f1fdb99 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:46.645492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4ed3cb9e-32ae-4603-a4f4-fb374f1fdb99 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:46.791077 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-4ed3cb9e-32ae-4603-a4f4-fb374f1fdb99 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:46.800942 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-4ed3cb9e-32ae-4603-a4f4-fb374f1fdb99 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:46.802475 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-4ed3cb9e-32ae-4603-a4f4-fb374f1fdb99 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:46.803757 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-4ed3cb9e-32ae-4603-a4f4-fb374f1fdb99 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1724 microversion: 2.20 time: 0.172860 Sep 23 15:22:46.804381 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 166/315] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:46 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:22:46.820050 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-e3236914-c4c0-4378-8d2a-b72d8e34033f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:46.820926 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-e3236914-c4c0-4378-8d2a-b72d8e34033f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:46.827930 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e3236914-c4c0-4378-8d2a-b72d8e34033f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:46.836951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e3236914-c4c0-4378-8d2a-b72d8e34033f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:46.836951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e3236914-c4c0-4378-8d2a-b72d8e34033f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:46.836951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e3236914-c4c0-4378-8d2a-b72d8e34033f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:46.836951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e3236914-c4c0-4378-8d2a-b72d8e34033f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:46.837527 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e3236914-c4c0-4378-8d2a-b72d8e34033f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:46.965266 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-e3236914-c4c0-4378-8d2a-b72d8e34033f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:46.975612 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-e3236914-c4c0-4378-8d2a-b72d8e34033f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1722 microversion: 2.1 time: 0.159261 Sep 23 15:22:46.976370 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 167/316] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:46 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:22:47.830009 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a5eb31cb-aaf5-47fd-abad-f4f4036ce642 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:47.830675 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-a5eb31cb-aaf5-47fd-abad-f4f4036ce642 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:47.837571 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a5eb31cb-aaf5-47fd-abad-f4f4036ce642 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:47.838201 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a5eb31cb-aaf5-47fd-abad-f4f4036ce642 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:47.838623 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a5eb31cb-aaf5-47fd-abad-f4f4036ce642 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:47.839587 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a5eb31cb-aaf5-47fd-abad-f4f4036ce642 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:47.840139 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a5eb31cb-aaf5-47fd-abad-f4f4036ce642 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:47.840629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a5eb31cb-aaf5-47fd-abad-f4f4036ce642 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:47.983344 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a5eb31cb-aaf5-47fd-abad-f4f4036ce642 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:47.992604 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a5eb31cb-aaf5-47fd-abad-f4f4036ce642 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:47.995334 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a5eb31cb-aaf5-47fd-abad-f4f4036ce642 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:47.996614 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-a5eb31cb-aaf5-47fd-abad-f4f4036ce642 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1724 microversion: 2.20 time: 0.171221 Sep 23 15:22:47.997166 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 168/317] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:47 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:22:48.002480 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-82f07b3f-b8c8-451d-8eea-14aa47799f59 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:48.003075 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-82f07b3f-b8c8-451d-8eea-14aa47799f59 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:48.009174 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-82f07b3f-b8c8-451d-8eea-14aa47799f59 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:48.011733 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-82f07b3f-b8c8-451d-8eea-14aa47799f59 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:48.011733 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-82f07b3f-b8c8-451d-8eea-14aa47799f59 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:48.011733 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-82f07b3f-b8c8-451d-8eea-14aa47799f59 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:48.011733 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-82f07b3f-b8c8-451d-8eea-14aa47799f59 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:48.012125 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-82f07b3f-b8c8-451d-8eea-14aa47799f59 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:48.149244 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-82f07b3f-b8c8-451d-8eea-14aa47799f59 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:48.158004 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-82f07b3f-b8c8-451d-8eea-14aa47799f59 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1722 microversion: 2.1 time: 0.159822 Sep 23 15:22:48.158820 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 169/318] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:47 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:49.023565 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-1d4c0364-789a-4f41-9eca-1d741f9e2654 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:49.028114 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-1d4c0364-789a-4f41-9eca-1d741f9e2654 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:49.031292 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1d4c0364-789a-4f41-9eca-1d741f9e2654 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:49.031776 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1d4c0364-789a-4f41-9eca-1d741f9e2654 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:49.032240 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1d4c0364-789a-4f41-9eca-1d741f9e2654 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:49.032925 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1d4c0364-789a-4f41-9eca-1d741f9e2654 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:49.033381 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1d4c0364-789a-4f41-9eca-1d741f9e2654 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:49.033802 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1d4c0364-789a-4f41-9eca-1d741f9e2654 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:49.177150 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-1d4c0364-789a-4f41-9eca-1d741f9e2654 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:49.180928 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-1d4c0364-789a-4f41-9eca-1d741f9e2654 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:49.182362 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-1d4c0364-789a-4f41-9eca-1d741f9e2654 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:49.183505 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-1d4c0364-789a-4f41-9eca-1d741f9e2654 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1724 microversion: 2.20 time: 0.163829 Sep 23 15:22:49.184076 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 170/319] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:49 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:22:49.189042 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-7e4e9576-5008-4402-a677-778e7a4d7ddd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:49.189632 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-7e4e9576-5008-4402-a677-778e7a4d7ddd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:49.195182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7e4e9576-5008-4402-a677-778e7a4d7ddd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:49.195656 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7e4e9576-5008-4402-a677-778e7a4d7ddd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:49.196114 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7e4e9576-5008-4402-a677-778e7a4d7ddd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:49.196795 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7e4e9576-5008-4402-a677-778e7a4d7ddd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:49.197236 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7e4e9576-5008-4402-a677-778e7a4d7ddd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:49.197652 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7e4e9576-5008-4402-a677-778e7a4d7ddd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:49.343165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-7e4e9576-5008-4402-a677-778e7a4d7ddd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:49.351540 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-7e4e9576-5008-4402-a677-778e7a4d7ddd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1722 microversion: 2.1 time: 0.166510 Sep 23 15:22:49.352843 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 171/320] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:49 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:50.209782 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-3b53cef2-dc76-43b5-b8e1-09aa4d0d0192 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:50.210511 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-3b53cef2-dc76-43b5-b8e1-09aa4d0d0192 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:50.217876 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3b53cef2-dc76-43b5-b8e1-09aa4d0d0192 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:50.218374 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3b53cef2-dc76-43b5-b8e1-09aa4d0d0192 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:50.218812 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3b53cef2-dc76-43b5-b8e1-09aa4d0d0192 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:50.219512 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3b53cef2-dc76-43b5-b8e1-09aa4d0d0192 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:50.219967 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3b53cef2-dc76-43b5-b8e1-09aa4d0d0192 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:50.220416 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3b53cef2-dc76-43b5-b8e1-09aa4d0d0192 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:50.360268 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-3b53cef2-dc76-43b5-b8e1-09aa4d0d0192 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:50.369085 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-3b53cef2-dc76-43b5-b8e1-09aa4d0d0192 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:50.370828 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-3b53cef2-dc76-43b5-b8e1-09aa4d0d0192 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:50.372809 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-3b53cef2-dc76-43b5-b8e1-09aa4d0d0192 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1745 microversion: 2.20 time: 0.166778 Sep 23 15:22:50.373620 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 172/321] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:50 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:22:50.390970 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.network.neutron [None req-00ce6b85-1561-40d9-9cbf-320ce8fb52ff tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] validate_networks() for [('5d0889b4-33f0-4d83-abe3-fa2925a19a90', None, None, None, None, None)] {{(pid=121448) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:22:50.402853 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-bc5fa7fd-f7bc-40e3-b2d1-d0de53867388 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:50.403457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-bc5fa7fd-f7bc-40e3-b2d1-d0de53867388 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:50.410596 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bc5fa7fd-f7bc-40e3-b2d1-d0de53867388 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:50.416464 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bc5fa7fd-f7bc-40e3-b2d1-d0de53867388 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:50.416464 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bc5fa7fd-f7bc-40e3-b2d1-d0de53867388 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:50.416464 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bc5fa7fd-f7bc-40e3-b2d1-d0de53867388 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:50.416464 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bc5fa7fd-f7bc-40e3-b2d1-d0de53867388 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:50.416853 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bc5fa7fd-f7bc-40e3-b2d1-d0de53867388 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:50.601485 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-bc5fa7fd-f7bc-40e3-b2d1-d0de53867388 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:50.613339 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-bc5fa7fd-f7bc-40e3-b2d1-d0de53867388 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1722 microversion: 2.1 time: 0.212751 Sep 23 15:22:50.615149 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 173/322] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:50 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:50.855152 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-00ce6b85-1561-40d9-9cbf-320ce8fb52ff tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Flavor limits 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:22:50.855578 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-00ce6b85-1561-40d9-9cbf-320ce8fb52ff tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Image limits 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:22:50.856202 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-00ce6b85-1561-40d9-9cbf-320ce8fb52ff tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Flavor pref 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:22:50.856617 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-00ce6b85-1561-40d9-9cbf-320ce8fb52ff tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Image pref 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:22:50.857026 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-00ce6b85-1561-40d9-9cbf-320ce8fb52ff tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:22:50.866714 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-00ce6b85-1561-40d9-9cbf-320ce8fb52ff tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:50.867181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-00ce6b85-1561-40d9-9cbf-320ce8fb52ff tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:50.867606 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-00ce6b85-1561-40d9-9cbf-320ce8fb52ff tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:50.868358 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-00ce6b85-1561-40d9-9cbf-320ce8fb52ff tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:50.868810 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-00ce6b85-1561-40d9-9cbf-320ce8fb52ff tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:50.869226 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-00ce6b85-1561-40d9-9cbf-320ce8fb52ff tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:50.892680 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-00ce6b85-1561-40d9-9cbf-320ce8fb52ff tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Getting quotas for project c9488f4d4af441168341205e0e936ce4. Resources: {'ram', 'instances', 'cores'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:22:50.892680 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-00ce6b85-1561-40d9-9cbf-320ce8fb52ff tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Getting quotas for user ee65edb3211b4b71a771594a90a342ff and project c9488f4d4af441168341205e0e936ce4. Resources: {'ram', 'instances', 'cores'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:22:50.901448 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-00ce6b85-1561-40d9-9cbf-320ce8fb52ff tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Going to run 1 instances... {{(pid=121448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:22:50.903802 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-00ce6b85-1561-40d9-9cbf-320ce8fb52ff tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='051c4746-7f50-4edb-b09d-a8935df360de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:22:51.129049 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-00ce6b85-1561-40d9-9cbf-320ce8fb52ff tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.522126 Sep 23 15:22:51.130146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 150/323] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Sep 23 15:22:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 6524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:22:51.142418 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-bfdf689c-76f0-4339-8d1a-773a5188fa42 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:51.143316 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-bfdf689c-76f0-4339-8d1a-773a5188fa42 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:51.200413 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-bfdf689c-76f0-4339-8d1a-773a5188fa42 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:51.209822 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-bfdf689c-76f0-4339-8d1a-773a5188fa42 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5" status: 200 len: 1219 microversion: 2.1 time: 0.072329 Sep 23 15:22:51.211632 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 174/324] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:51 2022] GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5 => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:51.405912 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-d803b774-682c-4069-a307-db901ab1ae2f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:51.406543 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-d803b774-682c-4069-a307-db901ab1ae2f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:51.415311 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d803b774-682c-4069-a307-db901ab1ae2f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:51.415811 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d803b774-682c-4069-a307-db901ab1ae2f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:51.416577 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d803b774-682c-4069-a307-db901ab1ae2f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:51.417212 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d803b774-682c-4069-a307-db901ab1ae2f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:51.417678 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d803b774-682c-4069-a307-db901ab1ae2f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:51.418106 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d803b774-682c-4069-a307-db901ab1ae2f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:51.567622 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-d803b774-682c-4069-a307-db901ab1ae2f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:51.580141 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-d803b774-682c-4069-a307-db901ab1ae2f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:51.582382 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-d803b774-682c-4069-a307-db901ab1ae2f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:51.583839 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-d803b774-682c-4069-a307-db901ab1ae2f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1745 microversion: 2.20 time: 0.182482 Sep 23 15:22:51.584939 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 151/325] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:51 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1745 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:22:51.644697 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-98a061ec-8fed-4cba-b6d5-cb7656f7abfd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:51.645322 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-98a061ec-8fed-4cba-b6d5-cb7656f7abfd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:51.651848 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-98a061ec-8fed-4cba-b6d5-cb7656f7abfd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:51.652521 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-98a061ec-8fed-4cba-b6d5-cb7656f7abfd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:51.652962 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-98a061ec-8fed-4cba-b6d5-cb7656f7abfd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:51.653665 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-98a061ec-8fed-4cba-b6d5-cb7656f7abfd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:51.654123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-98a061ec-8fed-4cba-b6d5-cb7656f7abfd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:51.655159 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-98a061ec-8fed-4cba-b6d5-cb7656f7abfd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:51.840889 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-98a061ec-8fed-4cba-b6d5-cb7656f7abfd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:51.855530 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-98a061ec-8fed-4cba-b6d5-cb7656f7abfd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1722 microversion: 2.1 time: 0.215299 Sep 23 15:22:51.868539 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 175/326] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:51 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:52.234490 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-64affe00-b3d7-4ae9-a0ef-c88315a867f0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:52.235107 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-64affe00-b3d7-4ae9-a0ef-c88315a867f0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:52.331444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-64affe00-b3d7-4ae9-a0ef-c88315a867f0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:52.339055 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-64affe00-b3d7-4ae9-a0ef-c88315a867f0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5" status: 200 len: 1219 microversion: 2.1 time: 0.108521 Sep 23 15:22:52.339925 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 152/327] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:52 2022] GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5 => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:52.611364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-af43a59d-c54c-4300-8e19-204ea4baa1cf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:52.617033 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-af43a59d-c54c-4300-8e19-204ea4baa1cf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:52.626352 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-af43a59d-c54c-4300-8e19-204ea4baa1cf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:52.627026 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-af43a59d-c54c-4300-8e19-204ea4baa1cf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:52.627420 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-af43a59d-c54c-4300-8e19-204ea4baa1cf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:52.629321 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-af43a59d-c54c-4300-8e19-204ea4baa1cf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:52.629876 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-af43a59d-c54c-4300-8e19-204ea4baa1cf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:52.630243 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-af43a59d-c54c-4300-8e19-204ea4baa1cf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:52.802606 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-af43a59d-c54c-4300-8e19-204ea4baa1cf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:52.811515 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-af43a59d-c54c-4300-8e19-204ea4baa1cf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:52.813010 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-af43a59d-c54c-4300-8e19-204ea4baa1cf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:52.814163 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-af43a59d-c54c-4300-8e19-204ea4baa1cf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1740 microversion: 2.20 time: 0.206903 Sep 23 15:22:52.814725 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 176/328] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:52 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:22:52.881273 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a4d8c5af-12bd-48ad-9aae-66d15c224601 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:52.882262 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-a4d8c5af-12bd-48ad-9aae-66d15c224601 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:52.890832 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a4d8c5af-12bd-48ad-9aae-66d15c224601 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:52.892321 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a4d8c5af-12bd-48ad-9aae-66d15c224601 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:52.892650 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a4d8c5af-12bd-48ad-9aae-66d15c224601 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:52.893366 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a4d8c5af-12bd-48ad-9aae-66d15c224601 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:52.893834 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a4d8c5af-12bd-48ad-9aae-66d15c224601 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:52.894263 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a4d8c5af-12bd-48ad-9aae-66d15c224601 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:53.105098 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a4d8c5af-12bd-48ad-9aae-66d15c224601 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:53.114585 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-a4d8c5af-12bd-48ad-9aae-66d15c224601 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1722 microversion: 2.1 time: 0.237585 Sep 23 15:22:53.116858 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 153/329] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:52 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:53.367862 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-280e925f-4963-4db2-b91e-588e2f24f00a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:53.368785 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-280e925f-4963-4db2-b91e-588e2f24f00a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:53.381310 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-280e925f-4963-4db2-b91e-588e2f24f00a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:53.383195 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-280e925f-4963-4db2-b91e-588e2f24f00a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:53.383830 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-280e925f-4963-4db2-b91e-588e2f24f00a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:53.384808 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-280e925f-4963-4db2-b91e-588e2f24f00a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:53.385424 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-280e925f-4963-4db2-b91e-588e2f24f00a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:53.386051 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-280e925f-4963-4db2-b91e-588e2f24f00a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:53.482258 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-280e925f-4963-4db2-b91e-588e2f24f00a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:53.495687 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-280e925f-4963-4db2-b91e-588e2f24f00a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5" status: 200 len: 1215 microversion: 2.1 time: 0.131846 Sep 23 15:22:53.496697 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 177/330] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:53 2022] GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5 => generated 1215 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:53.848526 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6a7625f9-5c05-47c7-834d-c35b67569247 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:53.849305 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-6a7625f9-5c05-47c7-834d-c35b67569247 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:53.856824 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6a7625f9-5c05-47c7-834d-c35b67569247 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:53.857796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6a7625f9-5c05-47c7-834d-c35b67569247 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:53.859032 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6a7625f9-5c05-47c7-834d-c35b67569247 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:53.859749 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6a7625f9-5c05-47c7-834d-c35b67569247 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:53.860303 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6a7625f9-5c05-47c7-834d-c35b67569247 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:53.860810 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6a7625f9-5c05-47c7-834d-c35b67569247 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:54.048831 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6a7625f9-5c05-47c7-834d-c35b67569247 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:54.060900 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6a7625f9-5c05-47c7-834d-c35b67569247 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:54.063166 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6a7625f9-5c05-47c7-834d-c35b67569247 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:54.065306 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-6a7625f9-5c05-47c7-834d-c35b67569247 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1740 microversion: 2.20 time: 0.221592 Sep 23 15:22:54.066072 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 154/331] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:53 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:22:54.145507 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-26f105a4-2b15-4cc2-ab8b-8573729e538f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:54.146138 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-26f105a4-2b15-4cc2-ab8b-8573729e538f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:54.157081 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-26f105a4-2b15-4cc2-ab8b-8573729e538f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:54.157827 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-26f105a4-2b15-4cc2-ab8b-8573729e538f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:54.158231 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-26f105a4-2b15-4cc2-ab8b-8573729e538f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:54.159450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-26f105a4-2b15-4cc2-ab8b-8573729e538f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:54.159920 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-26f105a4-2b15-4cc2-ab8b-8573729e538f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:54.160376 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-26f105a4-2b15-4cc2-ab8b-8573729e538f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:54.327258 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-26f105a4-2b15-4cc2-ab8b-8573729e538f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:54.343721 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-26f105a4-2b15-4cc2-ab8b-8573729e538f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1722 microversion: 2.1 time: 0.202130 Sep 23 15:22:54.344364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 178/332] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:54 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:54.524326 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-eb9578c6-810d-4312-bfcd-f137991bd59d tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:54.525299 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-eb9578c6-810d-4312-bfcd-f137991bd59d tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:54.532929 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-eb9578c6-810d-4312-bfcd-f137991bd59d tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:54.533426 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-eb9578c6-810d-4312-bfcd-f137991bd59d tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:54.534038 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-eb9578c6-810d-4312-bfcd-f137991bd59d tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:54.534964 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-eb9578c6-810d-4312-bfcd-f137991bd59d tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:54.537705 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-eb9578c6-810d-4312-bfcd-f137991bd59d tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:54.538565 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-eb9578c6-810d-4312-bfcd-f137991bd59d tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:54.680390 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-eb9578c6-810d-4312-bfcd-f137991bd59d tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:54.706062 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=100 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:54.713920 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-eb9578c6-810d-4312-bfcd-f137991bd59d tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5" status: 200 len: 1215 microversion: 2.1 time: 0.193571 Sep 23 15:22:54.720319 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 155/333] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:54 2022] GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5 => generated 1215 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:55.093934 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-ced8392b-dfdf-48b5-b6fb-4314aad9b99c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:55.097742 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-ced8392b-dfdf-48b5-b6fb-4314aad9b99c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:55.104747 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ced8392b-dfdf-48b5-b6fb-4314aad9b99c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:55.105640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ced8392b-dfdf-48b5-b6fb-4314aad9b99c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:55.106302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ced8392b-dfdf-48b5-b6fb-4314aad9b99c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:55.107102 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ced8392b-dfdf-48b5-b6fb-4314aad9b99c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:55.108478 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ced8392b-dfdf-48b5-b6fb-4314aad9b99c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:55.109101 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ced8392b-dfdf-48b5-b6fb-4314aad9b99c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:55.318465 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-ced8392b-dfdf-48b5-b6fb-4314aad9b99c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:55.323775 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=100 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:55.334330 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-ced8392b-dfdf-48b5-b6fb-4314aad9b99c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:55.341146 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-ced8392b-dfdf-48b5-b6fb-4314aad9b99c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:55.341146 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-ced8392b-dfdf-48b5-b6fb-4314aad9b99c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1740 microversion: 2.20 time: 0.249637 Sep 23 15:22:55.352288 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 179/334] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:55 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1740 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:22:55.370361 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-c62ea749-3dc9-43c5-bf12-383b5f3273f4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:55.370970 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-c62ea749-3dc9-43c5-bf12-383b5f3273f4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:55.378035 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c62ea749-3dc9-43c5-bf12-383b5f3273f4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:55.381227 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c62ea749-3dc9-43c5-bf12-383b5f3273f4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:55.381227 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c62ea749-3dc9-43c5-bf12-383b5f3273f4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:55.381227 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c62ea749-3dc9-43c5-bf12-383b5f3273f4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:55.381227 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c62ea749-3dc9-43c5-bf12-383b5f3273f4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:55.381651 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c62ea749-3dc9-43c5-bf12-383b5f3273f4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:55.742552 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-9499ca0d-9de7-44ff-bf59-35bc15b61b18 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:55.743187 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-9499ca0d-9de7-44ff-bf59-35bc15b61b18 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:55.773759 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9499ca0d-9de7-44ff-bf59-35bc15b61b18 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:55.774301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9499ca0d-9de7-44ff-bf59-35bc15b61b18 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:55.774746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9499ca0d-9de7-44ff-bf59-35bc15b61b18 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:55.777680 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9499ca0d-9de7-44ff-bf59-35bc15b61b18 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:55.778192 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9499ca0d-9de7-44ff-bf59-35bc15b61b18 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:55.783625 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9499ca0d-9de7-44ff-bf59-35bc15b61b18 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:55.796914 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-c62ea749-3dc9-43c5-bf12-383b5f3273f4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:55.809702 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-c62ea749-3dc9-43c5-bf12-383b5f3273f4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1722 microversion: 2.1 time: 0.443652 Sep 23 15:22:55.811286 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 156/335] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:55 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1722 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:55.883931 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-9499ca0d-9de7-44ff-bf59-35bc15b61b18 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:55.910698 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-9499ca0d-9de7-44ff-bf59-35bc15b61b18 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5" status: 200 len: 1215 microversion: 2.1 time: 0.167847 Sep 23 15:22:55.925165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 180/336] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:55 2022] GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5 => generated 1215 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:56.124161 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-91db3b73-bb28-4c97-bfec-f64c280c18af req-84b917dd-36d1-4ac0-ad55-352e8d034a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bba6fdd-bec4-491e-81ba-f3a9863f72ca", "name": "network-vif-plugged", "status": "completed", "tag": "8801bad0-f531-42e9-8015-b0d63a8e4f8e"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:22:56.135915 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-91db3b73-bb28-4c97-bfec-f64c280c18af req-84b917dd-36d1-4ac0-ad55-352e8d034a99 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:56.137013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-91db3b73-bb28-4c97-bfec-f64c280c18af req-84b917dd-36d1-4ac0-ad55-352e8d034a99 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:56.137740 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-91db3b73-bb28-4c97-bfec-f64c280c18af req-84b917dd-36d1-4ac0-ad55-352e8d034a99 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:56.152640 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-91db3b73-bb28-4c97-bfec-f64c280c18af req-84b917dd-36d1-4ac0-ad55-352e8d034a99 service nova] Creating event network-vif-plugged:8801bad0-f531-42e9-8015-b0d63a8e4f8e for instance 4bba6fdd-bec4-491e-81ba-f3a9863f72ca on hv-cinder-85530 Sep 23 15:22:56.159195 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-91db3b73-bb28-4c97-bfec-f64c280c18af req-84b917dd-36d1-4ac0-ad55-352e8d034a99 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038796 Sep 23 15:22:56.160833 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 157/337] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:22:56.367890 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-7a1a435e-4fc3-4b0e-bdc8-073c602e3ea7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:56.368537 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-7a1a435e-4fc3-4b0e-bdc8-073c602e3ea7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:56.371200 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:56.377573 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7a1a435e-4fc3-4b0e-bdc8-073c602e3ea7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:56.383268 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7a1a435e-4fc3-4b0e-bdc8-073c602e3ea7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:56.383268 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7a1a435e-4fc3-4b0e-bdc8-073c602e3ea7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:56.383268 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7a1a435e-4fc3-4b0e-bdc8-073c602e3ea7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:56.383268 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7a1a435e-4fc3-4b0e-bdc8-073c602e3ea7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:56.383637 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7a1a435e-4fc3-4b0e-bdc8-073c602e3ea7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:56.534089 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-7a1a435e-4fc3-4b0e-bdc8-073c602e3ea7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:56.542457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-7a1a435e-4fc3-4b0e-bdc8-073c602e3ea7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:56.543928 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-7a1a435e-4fc3-4b0e-bdc8-073c602e3ea7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:56.545146 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-7a1a435e-4fc3-4b0e-bdc8-073c602e3ea7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1740 microversion: 2.20 time: 0.182041 Sep 23 15:22:56.545772 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 181/338] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:56 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:22:56.839095 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-04a4ef11-f1f4-49fa-b5b3-48ccecd28a83 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:56.839795 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-04a4ef11-f1f4-49fa-b5b3-48ccecd28a83 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:56.846149 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-04a4ef11-f1f4-49fa-b5b3-48ccecd28a83 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:56.846640 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-04a4ef11-f1f4-49fa-b5b3-48ccecd28a83 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:56.847076 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-04a4ef11-f1f4-49fa-b5b3-48ccecd28a83 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:56.847769 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-04a4ef11-f1f4-49fa-b5b3-48ccecd28a83 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:56.848251 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-04a4ef11-f1f4-49fa-b5b3-48ccecd28a83 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:56.848680 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-04a4ef11-f1f4-49fa-b5b3-48ccecd28a83 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:56.934701 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-1a0c32d5-42bb-4870-9cf2-2785ac8a75e1 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:56.935309 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-1a0c32d5-42bb-4870-9cf2-2785ac8a75e1 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:56.942376 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1a0c32d5-42bb-4870-9cf2-2785ac8a75e1 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:56.942863 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1a0c32d5-42bb-4870-9cf2-2785ac8a75e1 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:56.943284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1a0c32d5-42bb-4870-9cf2-2785ac8a75e1 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:56.943967 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1a0c32d5-42bb-4870-9cf2-2785ac8a75e1 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:56.944442 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1a0c32d5-42bb-4870-9cf2-2785ac8a75e1 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:56.944856 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1a0c32d5-42bb-4870-9cf2-2785ac8a75e1 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:56.981915 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-04a4ef11-f1f4-49fa-b5b3-48ccecd28a83 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:56.990719 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-04a4ef11-f1f4-49fa-b5b3-48ccecd28a83 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1722 microversion: 2.1 time: 0.155715 Sep 23 15:22:56.991297 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 158/339] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:56 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:57.006909 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-1a0c32d5-42bb-4870-9cf2-2785ac8a75e1 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:57.015744 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-1a0c32d5-42bb-4870-9cf2-2785ac8a75e1 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5" status: 200 len: 1215 microversion: 2.1 time: 0.084828 Sep 23 15:22:57.018216 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 182/340] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:56 2022] GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5 => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:57.571472 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-5436bf13-fbdc-49be-bd2d-8e8e388af948 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:57.572304 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-5436bf13-fbdc-49be-bd2d-8e8e388af948 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:57.579877 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5436bf13-fbdc-49be-bd2d-8e8e388af948 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:57.580394 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5436bf13-fbdc-49be-bd2d-8e8e388af948 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:57.580830 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5436bf13-fbdc-49be-bd2d-8e8e388af948 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:57.581650 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5436bf13-fbdc-49be-bd2d-8e8e388af948 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:57.582165 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5436bf13-fbdc-49be-bd2d-8e8e388af948 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:57.582600 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5436bf13-fbdc-49be-bd2d-8e8e388af948 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:57.770431 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-5436bf13-fbdc-49be-bd2d-8e8e388af948 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:57.776805 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-5436bf13-fbdc-49be-bd2d-8e8e388af948 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:57.779131 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-5436bf13-fbdc-49be-bd2d-8e8e388af948 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:57.781626 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-5436bf13-fbdc-49be-bd2d-8e8e388af948 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1740 microversion: 2.20 time: 0.214459 Sep 23 15:22:57.782192 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 159/341] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:57 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1740 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:22:58.015757 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-f12147a7-71dd-4a2a-b1d3-9de26f0bf8f9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:58.016591 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-f12147a7-71dd-4a2a-b1d3-9de26f0bf8f9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:58.031918 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f12147a7-71dd-4a2a-b1d3-9de26f0bf8f9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:58.043066 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f12147a7-71dd-4a2a-b1d3-9de26f0bf8f9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:58.043680 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f12147a7-71dd-4a2a-b1d3-9de26f0bf8f9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:58.045843 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f12147a7-71dd-4a2a-b1d3-9de26f0bf8f9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:58.045971 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-eacad54e-a126-4a5b-be59-1ca05ce6098b tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:58.046449 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f12147a7-71dd-4a2a-b1d3-9de26f0bf8f9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:58.046533 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-eacad54e-a126-4a5b-be59-1ca05ce6098b tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:58.046858 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f12147a7-71dd-4a2a-b1d3-9de26f0bf8f9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:58.053765 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-eacad54e-a126-4a5b-be59-1ca05ce6098b tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:58.054805 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-eacad54e-a126-4a5b-be59-1ca05ce6098b tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:58.057048 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-eacad54e-a126-4a5b-be59-1ca05ce6098b tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:58.060328 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-eacad54e-a126-4a5b-be59-1ca05ce6098b tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:58.088906 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-eacad54e-a126-4a5b-be59-1ca05ce6098b tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:58.089828 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-eacad54e-a126-4a5b-be59-1ca05ce6098b tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:58.166431 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-eacad54e-a126-4a5b-be59-1ca05ce6098b tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:58.180955 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-eacad54e-a126-4a5b-be59-1ca05ce6098b tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5" status: 200 len: 1271 microversion: 2.1 time: 0.139803 Sep 23 15:22:58.182063 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 160/342] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:58 2022] GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5 => generated 1271 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:22:58.239971 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-f12147a7-71dd-4a2a-b1d3-9de26f0bf8f9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:58.249375 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-f12147a7-71dd-4a2a-b1d3-9de26f0bf8f9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1699 microversion: 2.1 time: 0.237443 Sep 23 15:22:58.260510 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 183/343] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:58 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1699 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:22:58.275542 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-53717642-5d5c-433f-b8fa-c4a0de8ce7d6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:22:58.288207 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-53717642-5d5c-433f-b8fa-c4a0de8ce7d6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:58.290522 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-53717642-5d5c-433f-b8fa-c4a0de8ce7d6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:58.290522 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-53717642-5d5c-433f-b8fa-c4a0de8ce7d6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:58.379637 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-53717642-5d5c-433f-b8fa-c4a0de8ce7d6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Going to try to start instance {{(pid=121448) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 23 15:22:58.673813 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-53717642-5d5c-433f-b8fa-c4a0de8ce7d6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "POST /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f/action" status: 202 len: 0 microversion: 2.1 time: 0.401807 Sep 23 15:22:58.674324 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 161/344] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Sep 23 15:22:58 2022] POST /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:22:58.683177 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-0a0aaf1f-111c-4999-9623-9a58342e3e30 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:58.684794 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-0a0aaf1f-111c-4999-9623-9a58342e3e30 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:58.691938 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0a0aaf1f-111c-4999-9623-9a58342e3e30 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:58.692589 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0a0aaf1f-111c-4999-9623-9a58342e3e30 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:58.693299 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0a0aaf1f-111c-4999-9623-9a58342e3e30 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:58.694568 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0a0aaf1f-111c-4999-9623-9a58342e3e30 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:58.695229 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0a0aaf1f-111c-4999-9623-9a58342e3e30 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:58.695654 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0a0aaf1f-111c-4999-9623-9a58342e3e30 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:58.810889 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-ca80aa12-7253-42e4-96b6-c71521ccbde2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:58.811892 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-ca80aa12-7253-42e4-96b6-c71521ccbde2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:58.830589 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ca80aa12-7253-42e4-96b6-c71521ccbde2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:58.831562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ca80aa12-7253-42e4-96b6-c71521ccbde2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:58.834711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ca80aa12-7253-42e4-96b6-c71521ccbde2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:58.835847 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ca80aa12-7253-42e4-96b6-c71521ccbde2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:58.836617 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ca80aa12-7253-42e4-96b6-c71521ccbde2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:58.838604 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ca80aa12-7253-42e4-96b6-c71521ccbde2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:59.083457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-0a0aaf1f-111c-4999-9623-9a58342e3e30 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:59.097411 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-0a0aaf1f-111c-4999-9623-9a58342e3e30 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1708 microversion: 2.1 time: 0.418091 Sep 23 15:22:59.108293 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 184/345] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:58 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1708 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:59.208768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-85b04fa4-6275-4f79-94c3-b18bb3fb9c3f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:59.209379 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-85b04fa4-6275-4f79-94c3-b18bb3fb9c3f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:59.214623 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-ca80aa12-7253-42e4-96b6-c71521ccbde2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:59.228416 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-ca80aa12-7253-42e4-96b6-c71521ccbde2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:59.232694 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-85b04fa4-6275-4f79-94c3-b18bb3fb9c3f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:59.234838 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-ca80aa12-7253-42e4-96b6-c71521ccbde2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:59.235816 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-85b04fa4-6275-4f79-94c3-b18bb3fb9c3f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:59.236451 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-85b04fa4-6275-4f79-94c3-b18bb3fb9c3f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:59.237353 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-85b04fa4-6275-4f79-94c3-b18bb3fb9c3f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:59.238770 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-ca80aa12-7253-42e4-96b6-c71521ccbde2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1740 microversion: 2.20 time: 0.433615 Sep 23 15:22:59.239403 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-85b04fa4-6275-4f79-94c3-b18bb3fb9c3f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:59.240302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-85b04fa4-6275-4f79-94c3-b18bb3fb9c3f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:59.242667 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 162/346] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:58 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1740 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:22:59.359915 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-85b04fa4-6275-4f79-94c3-b18bb3fb9c3f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:59.390443 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-85b04fa4-6275-4f79-94c3-b18bb3fb9c3f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5" status: 200 len: 1277 microversion: 2.1 time: 0.173336 Sep 23 15:22:59.395690 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 185/347] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:59 2022] GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5 => generated 1277 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:22:59.531783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-7aa1b8cb-8073-4d05-9b52-8af609727074 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1423095466", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2003426208", "security_groups": [{"name": "tempest-secgroup-smoke-1141311030"}], "networks": [{"uuid": "791f912d-07bc-4fff-ad75-2b567e29c1a8"}], "block_device_mapping_v2": [{"uuid": "348c2b7d-1bbd-4f57-9a5d-ef04736c9ae8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:22:59.847441 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.network.neutron [None req-7aa1b8cb-8073-4d05-9b52-8af609727074 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] validate_networks() for [('791f912d-07bc-4fff-ad75-2b567e29c1a8', None, None, None, None, None)] {{(pid=121448) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:23:00.125430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-7af2372c-f68e-491a-9fc0-cba83aef4241 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:00.127762 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-7af2372c-f68e-491a-9fc0-cba83aef4241 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:00.143666 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7af2372c-f68e-491a-9fc0-cba83aef4241 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:00.144603 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7af2372c-f68e-491a-9fc0-cba83aef4241 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:00.145471 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7af2372c-f68e-491a-9fc0-cba83aef4241 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:00.146478 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7af2372c-f68e-491a-9fc0-cba83aef4241 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:00.147109 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7af2372c-f68e-491a-9fc0-cba83aef4241 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:00.147759 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7af2372c-f68e-491a-9fc0-cba83aef4241 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:00.415441 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-7aa1b8cb-8073-4d05-9b52-8af609727074 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Flavor limits 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:23:00.415917 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-7aa1b8cb-8073-4d05-9b52-8af609727074 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Image limits 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:23:00.416429 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-7aa1b8cb-8073-4d05-9b52-8af609727074 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Flavor pref 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:23:00.416848 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-7aa1b8cb-8073-4d05-9b52-8af609727074 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Image pref 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:23:00.417264 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-7aa1b8cb-8073-4d05-9b52-8af609727074 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:23:00.439048 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7aa1b8cb-8073-4d05-9b52-8af609727074 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:00.440263 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7aa1b8cb-8073-4d05-9b52-8af609727074 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:00.440716 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7aa1b8cb-8073-4d05-9b52-8af609727074 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:00.441472 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7aa1b8cb-8073-4d05-9b52-8af609727074 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:00.441932 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7aa1b8cb-8073-4d05-9b52-8af609727074 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:00.445286 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7aa1b8cb-8073-4d05-9b52-8af609727074 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:00.478228 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-7aa1b8cb-8073-4d05-9b52-8af609727074 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Getting quotas for project 7c95b871ff2b4ed89195a9c0fa94e8b4. Resources: {'ram', 'instances', 'cores'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:23:00.484776 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-7aa1b8cb-8073-4d05-9b52-8af609727074 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Getting quotas for user 4bdaecd5dd5d461383878c4b96ef98be and project 7c95b871ff2b4ed89195a9c0fa94e8b4. Resources: {'ram', 'instances', 'cores'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:23:00.552008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-7af2372c-f68e-491a-9fc0-cba83aef4241 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:00.564718 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-7aa1b8cb-8073-4d05-9b52-8af609727074 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Going to run 1 instances... {{(pid=121448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:23:00.569107 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-7aa1b8cb-8073-4d05-9b52-8af609727074 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='348c2b7d-1bbd-4f57-9a5d-ef04736c9ae8',volume_size=None,volume_type=None)] {{(pid=121448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:23:00.579214 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-7af2372c-f68e-491a-9fc0-cba83aef4241 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1708 microversion: 2.1 time: 0.458033 Sep 23 15:23:00.585265 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 186/348] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:00 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1708 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:23:00.604545 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a97bce1a-778b-4ca7-8429-06e66385e6b5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:00.606651 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-a97bce1a-778b-4ca7-8429-06e66385e6b5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:00.624786 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a97bce1a-778b-4ca7-8429-06e66385e6b5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:00.627640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a97bce1a-778b-4ca7-8429-06e66385e6b5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:00.627640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a97bce1a-778b-4ca7-8429-06e66385e6b5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:00.628148 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a97bce1a-778b-4ca7-8429-06e66385e6b5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:00.628955 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a97bce1a-778b-4ca7-8429-06e66385e6b5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:00.629562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a97bce1a-778b-4ca7-8429-06e66385e6b5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:01.131145 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a97bce1a-778b-4ca7-8429-06e66385e6b5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:01.149300 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a97bce1a-778b-4ca7-8429-06e66385e6b5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:01.151574 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a97bce1a-778b-4ca7-8429-06e66385e6b5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:01.153090 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-a97bce1a-778b-4ca7-8429-06e66385e6b5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1740 microversion: 2.20 time: 0.565686 Sep 23 15:23:01.155109 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 187/349] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:00 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1740 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:01.161526 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-13d65c30-7dd4-4478-b8d3-17df4c637ab5 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:01.162481 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-13d65c30-7dd4-4478-b8d3-17df4c637ab5 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:01.169474 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-13d65c30-7dd4-4478-b8d3-17df4c637ab5 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:01.170966 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-13d65c30-7dd4-4478-b8d3-17df4c637ab5 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:01.171629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-13d65c30-7dd4-4478-b8d3-17df4c637ab5 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:01.172581 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-13d65c30-7dd4-4478-b8d3-17df4c637ab5 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:01.173226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-13d65c30-7dd4-4478-b8d3-17df4c637ab5 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:01.173975 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-13d65c30-7dd4-4478-b8d3-17df4c637ab5 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:01.206252 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell0:SELECT=2 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:01.363665 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-13d65c30-7dd4-4478-b8d3-17df4c637ab5 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:01.373107 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-13d65c30-7dd4-4478-b8d3-17df4c637ab5 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5" status: 200 len: 1319 microversion: 2.1 time: 0.216440 Sep 23 15:23:01.373778 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 188/350] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:01 2022] GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:01.611800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-1b75bf9b-3153-4453-b6ce-0e95cc43488d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:01.612446 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-1b75bf9b-3153-4453-b6ce-0e95cc43488d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:01.618541 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1b75bf9b-3153-4453-b6ce-0e95cc43488d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:01.619017 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1b75bf9b-3153-4453-b6ce-0e95cc43488d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:01.619442 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1b75bf9b-3153-4453-b6ce-0e95cc43488d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:01.620154 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1b75bf9b-3153-4453-b6ce-0e95cc43488d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:01.620603 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1b75bf9b-3153-4453-b6ce-0e95cc43488d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:01.621020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1b75bf9b-3153-4453-b6ce-0e95cc43488d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:01.788227 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-1b75bf9b-3153-4453-b6ce-0e95cc43488d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:01.797123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-1b75bf9b-3153-4453-b6ce-0e95cc43488d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1708 microversion: 2.1 time: 0.189960 Sep 23 15:23:01.797688 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 189/351] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:01 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1708 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:23:02.100385 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-7aa1b8cb-8073-4d05-9b52-8af609727074 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.573046 Sep 23 15:23:02.101343 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 163/352] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Sep 23 15:22:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 2575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:23:02.147438 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-4ab5adbb-e0a6-410c-8351-da73da72d58d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:02.148024 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-4ab5adbb-e0a6-410c-8351-da73da72d58d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:02.183215 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a0f7db66-5b05-4845-a15a-fa6fa1f3cbd4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:02.183950 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-a0f7db66-5b05-4845-a15a-fa6fa1f3cbd4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:02.203362 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a0f7db66-5b05-4845-a15a-fa6fa1f3cbd4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:02.206470 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a0f7db66-5b05-4845-a15a-fa6fa1f3cbd4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:02.207234 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a0f7db66-5b05-4845-a15a-fa6fa1f3cbd4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:02.210994 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a0f7db66-5b05-4845-a15a-fa6fa1f3cbd4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:02.213528 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a0f7db66-5b05-4845-a15a-fa6fa1f3cbd4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:02.214074 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a0f7db66-5b05-4845-a15a-fa6fa1f3cbd4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:02.267705 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-4ab5adbb-e0a6-410c-8351-da73da72d58d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:02.275172 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-4ab5adbb-e0a6-410c-8351-da73da72d58d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1089 microversion: 2.1 time: 0.165220 Sep 23 15:23:02.277868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 190/353] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:02 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1089 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:02.395748 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-9ae2687e-c0ff-482e-ae0f-62da19d4f811 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:02.396385 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-9ae2687e-c0ff-482e-ae0f-62da19d4f811 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:02.415887 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9ae2687e-c0ff-482e-ae0f-62da19d4f811 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:02.416541 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9ae2687e-c0ff-482e-ae0f-62da19d4f811 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:02.416978 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9ae2687e-c0ff-482e-ae0f-62da19d4f811 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:02.417679 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9ae2687e-c0ff-482e-ae0f-62da19d4f811 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:02.472878 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9ae2687e-c0ff-482e-ae0f-62da19d4f811 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:02.472878 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9ae2687e-c0ff-482e-ae0f-62da19d4f811 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:02.503380 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a0f7db66-5b05-4845-a15a-fa6fa1f3cbd4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:02.514122 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a0f7db66-5b05-4845-a15a-fa6fa1f3cbd4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:02.515897 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a0f7db66-5b05-4845-a15a-fa6fa1f3cbd4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:02.517379 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-a0f7db66-5b05-4845-a15a-fa6fa1f3cbd4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1740 microversion: 2.20 time: 0.338585 Sep 23 15:23:02.518476 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 164/354] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:02 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1740 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:02.608877 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-95d4775c-3acb-4fa1-be1e-473efcef486a req-8d6784f1-463a-4cd1-91c1-c32f0a12488c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "485ab2cf-cd2f-42e5-a625-bda9af6b99b5", "tag": "a77f6045-1b49-44c2-897a-62ae2ea00ad4"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:23:02.627779 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-95d4775c-3acb-4fa1-be1e-473efcef486a req-8d6784f1-463a-4cd1-91c1-c32f0a12488c service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:02.628568 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-95d4775c-3acb-4fa1-be1e-473efcef486a req-8d6784f1-463a-4cd1-91c1-c32f0a12488c service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:02.629147 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-95d4775c-3acb-4fa1-be1e-473efcef486a req-8d6784f1-463a-4cd1-91c1-c32f0a12488c service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:02.638079 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-9ae2687e-c0ff-482e-ae0f-62da19d4f811 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:02.648540 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-95d4775c-3acb-4fa1-be1e-473efcef486a req-8d6784f1-463a-4cd1-91c1-c32f0a12488c service nova] Creating event network-changed:a77f6045-1b49-44c2-897a-62ae2ea00ad4 for instance 485ab2cf-cd2f-42e5-a625-bda9af6b99b5 on hv-cinder-85530 Sep 23 15:23:02.651875 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-95d4775c-3acb-4fa1-be1e-473efcef486a req-8d6784f1-463a-4cd1-91c1-c32f0a12488c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051989 Sep 23 15:23:02.653425 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-9ae2687e-c0ff-482e-ae0f-62da19d4f811 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5" status: 200 len: 1319 microversion: 2.1 time: 0.261138 Sep 23 15:23:02.657420 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 191/355] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:02 2022] GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:23:02.658586 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 165/356] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:23:02.824350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-f6c94392-cb38-4279-8f7a-833d43cdc378 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:02.825743 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-f6c94392-cb38-4279-8f7a-833d43cdc378 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:02.839584 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f6c94392-cb38-4279-8f7a-833d43cdc378 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:02.842670 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f6c94392-cb38-4279-8f7a-833d43cdc378 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:02.843176 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f6c94392-cb38-4279-8f7a-833d43cdc378 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:02.844137 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f6c94392-cb38-4279-8f7a-833d43cdc378 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:02.844730 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f6c94392-cb38-4279-8f7a-833d43cdc378 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:02.846179 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f6c94392-cb38-4279-8f7a-833d43cdc378 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:03.103152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-f6c94392-cb38-4279-8f7a-833d43cdc378 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:03.115656 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-f6c94392-cb38-4279-8f7a-833d43cdc378 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1712 microversion: 2.1 time: 0.296687 Sep 23 15:23:03.116669 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 192/357] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:02 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1712 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:03.307600 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-87fff6b8-b0df-4eb6-aa47-125ae0d94906 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:03.311418 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-87fff6b8-b0df-4eb6-aa47-125ae0d94906 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:03.390206 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-87fff6b8-b0df-4eb6-aa47-125ae0d94906 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:03.398999 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-87fff6b8-b0df-4eb6-aa47-125ae0d94906 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1089 microversion: 2.1 time: 0.099878 Sep 23 15:23:03.399919 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 166/358] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:03 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1089 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:03.544153 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-d6aeb0d3-b26e-4a3a-9281-cc42c315c826 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:03.545024 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-d6aeb0d3-b26e-4a3a-9281-cc42c315c826 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:03.553898 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d6aeb0d3-b26e-4a3a-9281-cc42c315c826 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:03.554378 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d6aeb0d3-b26e-4a3a-9281-cc42c315c826 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:03.554804 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d6aeb0d3-b26e-4a3a-9281-cc42c315c826 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:03.555494 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d6aeb0d3-b26e-4a3a-9281-cc42c315c826 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:03.555940 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d6aeb0d3-b26e-4a3a-9281-cc42c315c826 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:03.556416 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d6aeb0d3-b26e-4a3a-9281-cc42c315c826 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:03.688193 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-7d93c2a0-db74-4ffd-8a30-7fa9f2eb7faa tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:03.692020 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-7d93c2a0-db74-4ffd-8a30-7fa9f2eb7faa tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:03.703846 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7d93c2a0-db74-4ffd-8a30-7fa9f2eb7faa tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:03.704497 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7d93c2a0-db74-4ffd-8a30-7fa9f2eb7faa tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:03.705084 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7d93c2a0-db74-4ffd-8a30-7fa9f2eb7faa tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:03.706078 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7d93c2a0-db74-4ffd-8a30-7fa9f2eb7faa tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:03.706684 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7d93c2a0-db74-4ffd-8a30-7fa9f2eb7faa tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:03.707246 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7d93c2a0-db74-4ffd-8a30-7fa9f2eb7faa tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:03.801806 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-d6aeb0d3-b26e-4a3a-9281-cc42c315c826 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:03.839095 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-d6aeb0d3-b26e-4a3a-9281-cc42c315c826 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:03.850707 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-d6aeb0d3-b26e-4a3a-9281-cc42c315c826 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:03.852020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-d6aeb0d3-b26e-4a3a-9281-cc42c315c826 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1740 microversion: 2.20 time: 0.312432 Sep 23 15:23:03.852596 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 193/359] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:03 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1740 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:03.983860 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-7d93c2a0-db74-4ffd-8a30-7fa9f2eb7faa tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:03.994690 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-7d93c2a0-db74-4ffd-8a30-7fa9f2eb7faa tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5" status: 200 len: 1319 microversion: 2.1 time: 0.319449 Sep 23 15:23:04.008500 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 167/360] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:03 2022] GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5 => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:23:04.430515 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b1d0ae78-c83e-4fd6-b274-d3e6ebd5ca8b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:04.430515 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-b1d0ae78-c83e-4fd6-b274-d3e6ebd5ca8b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:04.452958 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b1d0ae78-c83e-4fd6-b274-d3e6ebd5ca8b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:04.453458 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b1d0ae78-c83e-4fd6-b274-d3e6ebd5ca8b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:04.453898 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b1d0ae78-c83e-4fd6-b274-d3e6ebd5ca8b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:04.455166 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b1d0ae78-c83e-4fd6-b274-d3e6ebd5ca8b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:04.456806 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b1d0ae78-c83e-4fd6-b274-d3e6ebd5ca8b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:04.457242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b1d0ae78-c83e-4fd6-b274-d3e6ebd5ca8b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:04.534321 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-b1d0ae78-c83e-4fd6-b274-d3e6ebd5ca8b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:04.546171 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-b1d0ae78-c83e-4fd6-b274-d3e6ebd5ca8b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1139 microversion: 2.1 time: 0.121123 Sep 23 15:23:04.551028 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 194/361] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:04 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1139 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:04.885255 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-65996f17-871f-4011-89e3-ac4c2f0cf8af tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:04.886176 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-65996f17-871f-4011-89e3-ac4c2f0cf8af tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:04.897088 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-65996f17-871f-4011-89e3-ac4c2f0cf8af tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:04.899089 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-65996f17-871f-4011-89e3-ac4c2f0cf8af tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:04.899535 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-65996f17-871f-4011-89e3-ac4c2f0cf8af tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:04.900294 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-65996f17-871f-4011-89e3-ac4c2f0cf8af tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:04.901110 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-65996f17-871f-4011-89e3-ac4c2f0cf8af tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:04.901741 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-65996f17-871f-4011-89e3-ac4c2f0cf8af tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:05.021976 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-5df959ac-d870-4a2d-958a-f5d289a7c857 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:05.022572 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-5df959ac-d870-4a2d-958a-f5d289a7c857 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:05.029342 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5df959ac-d870-4a2d-958a-f5d289a7c857 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:05.033871 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5df959ac-d870-4a2d-958a-f5d289a7c857 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:05.035187 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5df959ac-d870-4a2d-958a-f5d289a7c857 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:05.038415 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5df959ac-d870-4a2d-958a-f5d289a7c857 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:05.039557 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5df959ac-d870-4a2d-958a-f5d289a7c857 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:05.040259 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5df959ac-d870-4a2d-958a-f5d289a7c857 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:05.135533 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-65996f17-871f-4011-89e3-ac4c2f0cf8af tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:05.153587 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-65996f17-871f-4011-89e3-ac4c2f0cf8af tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:05.155461 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-65996f17-871f-4011-89e3-ac4c2f0cf8af tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:05.157146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-65996f17-871f-4011-89e3-ac4c2f0cf8af tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1740 microversion: 2.20 time: 0.277253 Sep 23 15:23:05.158185 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 168/362] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:04 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1740 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:05.250181 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-5df959ac-d870-4a2d-958a-f5d289a7c857 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:05.259451 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-5df959ac-d870-4a2d-958a-f5d289a7c857 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5" status: 200 len: 1319 microversion: 2.1 time: 0.241096 Sep 23 15:23:05.260970 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 195/363] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:05 2022] GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:05.586543 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-dd75be86-7a65-413c-b93c-c4e8a8a7aa69 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:05.587491 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-dd75be86-7a65-413c-b93c-c4e8a8a7aa69 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:05.594316 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dd75be86-7a65-413c-b93c-c4e8a8a7aa69 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:05.595063 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dd75be86-7a65-413c-b93c-c4e8a8a7aa69 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:05.595657 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dd75be86-7a65-413c-b93c-c4e8a8a7aa69 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:05.596576 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dd75be86-7a65-413c-b93c-c4e8a8a7aa69 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:05.597321 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dd75be86-7a65-413c-b93c-c4e8a8a7aa69 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:05.597945 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dd75be86-7a65-413c-b93c-c4e8a8a7aa69 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:05.693086 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-dd75be86-7a65-413c-b93c-c4e8a8a7aa69 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:05.700863 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-dd75be86-7a65-413c-b93c-c4e8a8a7aa69 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1139 microversion: 2.1 time: 0.118493 Sep 23 15:23:05.701797 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 169/364] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:05 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1139 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:06.186744 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b6163a31-fe1c-42c5-b116-617874ba91e2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:06.187399 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-b6163a31-fe1c-42c5-b116-617874ba91e2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:06.193912 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b6163a31-fe1c-42c5-b116-617874ba91e2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:06.194433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b6163a31-fe1c-42c5-b116-617874ba91e2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:06.194892 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b6163a31-fe1c-42c5-b116-617874ba91e2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:06.195613 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b6163a31-fe1c-42c5-b116-617874ba91e2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:06.196104 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b6163a31-fe1c-42c5-b116-617874ba91e2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:06.196532 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b6163a31-fe1c-42c5-b116-617874ba91e2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:06.284818 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-b80ebf65-7b62-4250-b8a9-e2251e82ada8 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:06.286653 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-b80ebf65-7b62-4250-b8a9-e2251e82ada8 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:06.291539 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b80ebf65-7b62-4250-b8a9-e2251e82ada8 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:06.292159 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b80ebf65-7b62-4250-b8a9-e2251e82ada8 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:06.292739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b80ebf65-7b62-4250-b8a9-e2251e82ada8 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:06.293486 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b80ebf65-7b62-4250-b8a9-e2251e82ada8 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:06.293928 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b80ebf65-7b62-4250-b8a9-e2251e82ada8 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:06.294555 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b80ebf65-7b62-4250-b8a9-e2251e82ada8 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:06.347154 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-b6163a31-fe1c-42c5-b116-617874ba91e2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:06.355834 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-b6163a31-fe1c-42c5-b116-617874ba91e2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:06.357421 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-b6163a31-fe1c-42c5-b116-617874ba91e2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:06.358696 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-b6163a31-fe1c-42c5-b116-617874ba91e2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1740 microversion: 2.20 time: 0.177380 Sep 23 15:23:06.359367 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 196/365] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:06 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:06.434500 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b80ebf65-7b62-4250-b8a9-e2251e82ada8 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:06.442824 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-b80ebf65-7b62-4250-b8a9-e2251e82ada8 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5" status: 200 len: 1319 microversion: 2.1 time: 0.163993 Sep 23 15:23:06.443384 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 170/366] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:06 2022] GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:23:06.724405 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-5ea280e8-8934-4d9b-ae0e-b9bd978b8a47 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:06.725008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-5ea280e8-8934-4d9b-ae0e-b9bd978b8a47 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:06.733076 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5ea280e8-8934-4d9b-ae0e-b9bd978b8a47 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:06.733557 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5ea280e8-8934-4d9b-ae0e-b9bd978b8a47 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:06.733989 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5ea280e8-8934-4d9b-ae0e-b9bd978b8a47 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:06.734673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5ea280e8-8934-4d9b-ae0e-b9bd978b8a47 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:06.735180 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5ea280e8-8934-4d9b-ae0e-b9bd978b8a47 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:06.735546 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5ea280e8-8934-4d9b-ae0e-b9bd978b8a47 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:06.754119 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=100 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:06.800562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-5ea280e8-8934-4d9b-ae0e-b9bd978b8a47 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:06.808255 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-5ea280e8-8934-4d9b-ae0e-b9bd978b8a47 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1139 microversion: 2.1 time: 0.087612 Sep 23 15:23:06.808933 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 197/367] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:06 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1139 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:07.393947 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-805332a8-9f11-48a0-91cc-8af2561ddb11 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:07.395427 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-805332a8-9f11-48a0-91cc-8af2561ddb11 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:07.403346 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-805332a8-9f11-48a0-91cc-8af2561ddb11 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:07.404625 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-805332a8-9f11-48a0-91cc-8af2561ddb11 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:07.405261 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-805332a8-9f11-48a0-91cc-8af2561ddb11 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:07.406044 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-805332a8-9f11-48a0-91cc-8af2561ddb11 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:07.407002 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-805332a8-9f11-48a0-91cc-8af2561ddb11 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:07.407642 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-805332a8-9f11-48a0-91cc-8af2561ddb11 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:07.469839 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-17452f00-27c0-4b77-8502-548d2d9a9a04 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:07.470408 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-17452f00-27c0-4b77-8502-548d2d9a9a04 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:07.479138 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-17452f00-27c0-4b77-8502-548d2d9a9a04 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:07.479943 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-17452f00-27c0-4b77-8502-548d2d9a9a04 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:07.480572 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-17452f00-27c0-4b77-8502-548d2d9a9a04 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:07.481458 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-17452f00-27c0-4b77-8502-548d2d9a9a04 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:07.482611 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-17452f00-27c0-4b77-8502-548d2d9a9a04 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:07.483750 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-17452f00-27c0-4b77-8502-548d2d9a9a04 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:07.613964 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-805332a8-9f11-48a0-91cc-8af2561ddb11 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:07.624066 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-805332a8-9f11-48a0-91cc-8af2561ddb11 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:07.627193 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-805332a8-9f11-48a0-91cc-8af2561ddb11 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:07.629595 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-805332a8-9f11-48a0-91cc-8af2561ddb11 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1740 microversion: 2.20 time: 0.248176 Sep 23 15:23:07.630728 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 171/368] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:07 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1740 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:07.683185 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-17452f00-27c0-4b77-8502-548d2d9a9a04 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:07.699043 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-17452f00-27c0-4b77-8502-548d2d9a9a04 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5" status: 200 len: 1319 microversion: 2.1 time: 0.235772 Sep 23 15:23:07.700058 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 198/369] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:07 2022] GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:23:07.832777 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-187e11a8-2294-4f95-bbf1-12a14d604a4d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:07.833407 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-187e11a8-2294-4f95-bbf1-12a14d604a4d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:07.839508 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-187e11a8-2294-4f95-bbf1-12a14d604a4d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:07.840222 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-187e11a8-2294-4f95-bbf1-12a14d604a4d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:07.840771 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-187e11a8-2294-4f95-bbf1-12a14d604a4d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:07.842206 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-187e11a8-2294-4f95-bbf1-12a14d604a4d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:07.842331 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-187e11a8-2294-4f95-bbf1-12a14d604a4d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:07.842986 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-187e11a8-2294-4f95-bbf1-12a14d604a4d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:07.917747 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-187e11a8-2294-4f95-bbf1-12a14d604a4d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:07.926812 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-187e11a8-2294-4f95-bbf1-12a14d604a4d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1187 microversion: 2.1 time: 0.097994 Sep 23 15:23:07.927478 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 172/370] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:07 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1187 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:08.659660 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-c73a5df3-47f9-46cc-a52a-6cbd531e7f1c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:08.660491 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-c73a5df3-47f9-46cc-a52a-6cbd531e7f1c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:08.672310 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c73a5df3-47f9-46cc-a52a-6cbd531e7f1c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:08.672310 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c73a5df3-47f9-46cc-a52a-6cbd531e7f1c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:08.672842 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c73a5df3-47f9-46cc-a52a-6cbd531e7f1c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:08.674137 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c73a5df3-47f9-46cc-a52a-6cbd531e7f1c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:08.674875 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c73a5df3-47f9-46cc-a52a-6cbd531e7f1c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:08.675523 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c73a5df3-47f9-46cc-a52a-6cbd531e7f1c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:08.725091 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-450b539e-180c-43d6-b60a-a92aeba4ef5d tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:08.725771 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-450b539e-180c-43d6-b60a-a92aeba4ef5d tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:08.742878 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-450b539e-180c-43d6-b60a-a92aeba4ef5d tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:08.744093 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-450b539e-180c-43d6-b60a-a92aeba4ef5d tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:08.744703 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-450b539e-180c-43d6-b60a-a92aeba4ef5d tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:08.745717 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-450b539e-180c-43d6-b60a-a92aeba4ef5d tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:08.746345 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-450b539e-180c-43d6-b60a-a92aeba4ef5d tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:08.746849 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-450b539e-180c-43d6-b60a-a92aeba4ef5d tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:08.896159 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-450b539e-180c-43d6-b60a-a92aeba4ef5d tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:08.906159 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-450b539e-180c-43d6-b60a-a92aeba4ef5d tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5" status: 200 len: 1319 microversion: 2.1 time: 0.185559 Sep 23 15:23:08.907168 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 173/371] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:08 2022] GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:23:08.952699 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-8f885383-b926-4659-9c84-927e5946a4cf tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:08.953347 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-8f885383-b926-4659-9c84-927e5946a4cf tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:08.957841 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:08.962942 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8f885383-b926-4659-9c84-927e5946a4cf tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:08.963432 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8f885383-b926-4659-9c84-927e5946a4cf tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:08.963930 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8f885383-b926-4659-9c84-927e5946a4cf tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:08.964659 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8f885383-b926-4659-9c84-927e5946a4cf tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:08.965108 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8f885383-b926-4659-9c84-927e5946a4cf tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:08.965538 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8f885383-b926-4659-9c84-927e5946a4cf tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:08.988428 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:08.991759 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-c73a5df3-47f9-46cc-a52a-6cbd531e7f1c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:09.002397 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-c73a5df3-47f9-46cc-a52a-6cbd531e7f1c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:09.005072 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-c73a5df3-47f9-46cc-a52a-6cbd531e7f1c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:09.006736 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-c73a5df3-47f9-46cc-a52a-6cbd531e7f1c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1740 microversion: 2.20 time: 0.352319 Sep 23 15:23:09.008577 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 199/372] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:08 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1740 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:09.034384 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-8f885383-b926-4659-9c84-927e5946a4cf tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:09.051222 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-8f885383-b926-4659-9c84-927e5946a4cf tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1195 microversion: 2.1 time: 0.096277 Sep 23 15:23:09.051222 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 174/373] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:08 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1195 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:23:09.929139 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-d681a082-b328-4f36-bb5d-3ae8ca21ad2a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:09.929781 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-d681a082-b328-4f36-bb5d-3ae8ca21ad2a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:09.937203 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d681a082-b328-4f36-bb5d-3ae8ca21ad2a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:09.937679 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d681a082-b328-4f36-bb5d-3ae8ca21ad2a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:09.938109 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d681a082-b328-4f36-bb5d-3ae8ca21ad2a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:09.938788 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d681a082-b328-4f36-bb5d-3ae8ca21ad2a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:09.939237 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d681a082-b328-4f36-bb5d-3ae8ca21ad2a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:09.939656 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d681a082-b328-4f36-bb5d-3ae8ca21ad2a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:10.036573 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-d2d3364f-8d67-44b3-9b86-77de1a835fbd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:10.037994 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-d2d3364f-8d67-44b3-9b86-77de1a835fbd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:10.058291 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d2d3364f-8d67-44b3-9b86-77de1a835fbd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:10.058795 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d2d3364f-8d67-44b3-9b86-77de1a835fbd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:10.059238 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d2d3364f-8d67-44b3-9b86-77de1a835fbd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:10.061020 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d2d3364f-8d67-44b3-9b86-77de1a835fbd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:10.061492 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d2d3364f-8d67-44b3-9b86-77de1a835fbd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:10.070684 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d2d3364f-8d67-44b3-9b86-77de1a835fbd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:10.162340 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-d681a082-b328-4f36-bb5d-3ae8ca21ad2a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:10.175363 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-d681a082-b328-4f36-bb5d-3ae8ca21ad2a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5" status: 200 len: 1319 microversion: 2.1 time: 0.245779 Sep 23 15:23:10.175363 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 200/374] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:09 2022] GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:10.177078 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-cf4b143e-2389-4c61-8594-de93800b8229 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:10.177862 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-cf4b143e-2389-4c61-8594-de93800b8229 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:10.184262 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cf4b143e-2389-4c61-8594-de93800b8229 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:10.185812 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cf4b143e-2389-4c61-8594-de93800b8229 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:10.186322 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cf4b143e-2389-4c61-8594-de93800b8229 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:10.187021 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cf4b143e-2389-4c61-8594-de93800b8229 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:10.187471 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cf4b143e-2389-4c61-8594-de93800b8229 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:10.187887 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cf4b143e-2389-4c61-8594-de93800b8229 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:10.232776 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-d2d3364f-8d67-44b3-9b86-77de1a835fbd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:10.238171 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-d2d3364f-8d67-44b3-9b86-77de1a835fbd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:10.239609 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-d2d3364f-8d67-44b3-9b86-77de1a835fbd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:10.240798 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-d2d3364f-8d67-44b3-9b86-77de1a835fbd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1722 microversion: 2.20 time: 0.210396 Sep 23 15:23:10.241352 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 175/375] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:10 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:23:10.284930 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-cf4b143e-2389-4c61-8594-de93800b8229 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:10.293114 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-cf4b143e-2389-4c61-8594-de93800b8229 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1205 microversion: 2.1 time: 0.120301 Sep 23 15:23:10.312737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 201/376] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:10 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1205 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:10.568192 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-0feb7578-79af-436e-ad14-041d421b9577 req-4b5e17f5-aa7d-4d16-a8bc-e208d01a6e4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "485ab2cf-cd2f-42e5-a625-bda9af6b99b5", "name": "network-vif-plugged", "status": "completed", "tag": "a77f6045-1b49-44c2-897a-62ae2ea00ad4"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:23:10.575130 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell0:SELECT=4 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:10.580780 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-0feb7578-79af-436e-ad14-041d421b9577 req-4b5e17f5-aa7d-4d16-a8bc-e208d01a6e4d service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:10.581340 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-0feb7578-79af-436e-ad14-041d421b9577 req-4b5e17f5-aa7d-4d16-a8bc-e208d01a6e4d service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:10.581923 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-0feb7578-79af-436e-ad14-041d421b9577 req-4b5e17f5-aa7d-4d16-a8bc-e208d01a6e4d service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:10.594793 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-0feb7578-79af-436e-ad14-041d421b9577 req-4b5e17f5-aa7d-4d16-a8bc-e208d01a6e4d service nova] Creating event network-vif-plugged:a77f6045-1b49-44c2-897a-62ae2ea00ad4 for instance 485ab2cf-cd2f-42e5-a625-bda9af6b99b5 on hv-cinder-85530 Sep 23 15:23:10.600200 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-0feb7578-79af-436e-ad14-041d421b9577 req-4b5e17f5-aa7d-4d16-a8bc-e208d01a6e4d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035832 Sep 23 15:23:10.600915 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 176/377] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:23:11.194725 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-1852e623-fef1-4065-8bb4-e242ad785447 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:11.195408 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-1852e623-fef1-4065-8bb4-e242ad785447 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:11.203311 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1852e623-fef1-4065-8bb4-e242ad785447 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:11.203792 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1852e623-fef1-4065-8bb4-e242ad785447 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:11.204251 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1852e623-fef1-4065-8bb4-e242ad785447 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:11.204946 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1852e623-fef1-4065-8bb4-e242ad785447 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:11.209133 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1852e623-fef1-4065-8bb4-e242ad785447 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:11.209133 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1852e623-fef1-4065-8bb4-e242ad785447 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:11.268685 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-b22b10ca-f249-4934-963e-1f1eaa6b0d11 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:11.269294 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-b22b10ca-f249-4934-963e-1f1eaa6b0d11 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:11.276522 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b22b10ca-f249-4934-963e-1f1eaa6b0d11 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:11.277013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b22b10ca-f249-4934-963e-1f1eaa6b0d11 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:11.277471 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b22b10ca-f249-4934-963e-1f1eaa6b0d11 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:11.278668 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b22b10ca-f249-4934-963e-1f1eaa6b0d11 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:11.279126 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b22b10ca-f249-4934-963e-1f1eaa6b0d11 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:11.279553 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b22b10ca-f249-4934-963e-1f1eaa6b0d11 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:11.410636 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-1852e623-fef1-4065-8bb4-e242ad785447 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:11.444801 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-1852e623-fef1-4065-8bb4-e242ad785447 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5" status: 200 len: 1319 microversion: 2.1 time: 0.250881 Sep 23 15:23:11.449125 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 202/378] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:11 2022] GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:11.467793 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-5d682cd6-52a1-4724-8ffd-fac7e87c59ae tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:11.482731 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-5d682cd6-52a1-4724-8ffd-fac7e87c59ae tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:11.489432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5d682cd6-52a1-4724-8ffd-fac7e87c59ae tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:11.494080 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5d682cd6-52a1-4724-8ffd-fac7e87c59ae tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:11.494785 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5d682cd6-52a1-4724-8ffd-fac7e87c59ae tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:11.496536 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5d682cd6-52a1-4724-8ffd-fac7e87c59ae tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:11.500151 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5d682cd6-52a1-4724-8ffd-fac7e87c59ae tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:11.500812 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5d682cd6-52a1-4724-8ffd-fac7e87c59ae tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:11.567430 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b22b10ca-f249-4934-963e-1f1eaa6b0d11 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:11.579512 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b22b10ca-f249-4934-963e-1f1eaa6b0d11 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:11.590079 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b22b10ca-f249-4934-963e-1f1eaa6b0d11 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:11.599502 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-b22b10ca-f249-4934-963e-1f1eaa6b0d11 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1722 microversion: 2.20 time: 0.328306 Sep 23 15:23:11.600168 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 177/379] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:11 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1722 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:23:11.901039 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-5d682cd6-52a1-4724-8ffd-fac7e87c59ae tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:11.914683 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-5d682cd6-52a1-4724-8ffd-fac7e87c59ae tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1273 microversion: 2.1 time: 0.464411 Sep 23 15:23:11.915571 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 203/380] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:11 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1273 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:12.468276 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-00c8c993-ccdf-45c2-970d-37e8cba30382 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:12.469417 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-00c8c993-ccdf-45c2-970d-37e8cba30382 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:12.476493 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-00c8c993-ccdf-45c2-970d-37e8cba30382 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:12.476989 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-00c8c993-ccdf-45c2-970d-37e8cba30382 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:12.478241 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-00c8c993-ccdf-45c2-970d-37e8cba30382 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:12.479157 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-00c8c993-ccdf-45c2-970d-37e8cba30382 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:12.480175 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-00c8c993-ccdf-45c2-970d-37e8cba30382 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:12.480951 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-00c8c993-ccdf-45c2-970d-37e8cba30382 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:12.626692 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-8c8a3e28-ffb1-4ee5-9859-5c6ac725f94f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:12.627467 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-8c8a3e28-ffb1-4ee5-9859-5c6ac725f94f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:12.629733 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell0:SELECT=2 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:12.632877 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-00c8c993-ccdf-45c2-970d-37e8cba30382 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:12.635046 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c8a3e28-ffb1-4ee5-9859-5c6ac725f94f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:12.635534 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c8a3e28-ffb1-4ee5-9859-5c6ac725f94f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:12.636015 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c8a3e28-ffb1-4ee5-9859-5c6ac725f94f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:12.636715 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c8a3e28-ffb1-4ee5-9859-5c6ac725f94f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:12.637167 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c8a3e28-ffb1-4ee5-9859-5c6ac725f94f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:12.637684 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c8a3e28-ffb1-4ee5-9859-5c6ac725f94f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:12.641512 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-00c8c993-ccdf-45c2-970d-37e8cba30382 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5" status: 200 len: 1319 microversion: 2.1 time: 0.178668 Sep 23 15:23:12.652178 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 178/381] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:12 2022] GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:12.945214 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-e4e518f4-1c4c-4118-a0a4-fe16a30a7358 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:12.946003 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-e4e518f4-1c4c-4118-a0a4-fe16a30a7358 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:12.959909 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e4e518f4-1c4c-4118-a0a4-fe16a30a7358 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:12.959909 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e4e518f4-1c4c-4118-a0a4-fe16a30a7358 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:12.959909 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e4e518f4-1c4c-4118-a0a4-fe16a30a7358 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:12.959909 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e4e518f4-1c4c-4118-a0a4-fe16a30a7358 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:12.960489 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e4e518f4-1c4c-4118-a0a4-fe16a30a7358 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:12.960739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e4e518f4-1c4c-4118-a0a4-fe16a30a7358 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:13.109221 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-8c8a3e28-ffb1-4ee5-9859-5c6ac725f94f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:13.118087 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-8c8a3e28-ffb1-4ee5-9859-5c6ac725f94f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:13.119863 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-8c8a3e28-ffb1-4ee5-9859-5c6ac725f94f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:13.121017 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-8c8a3e28-ffb1-4ee5-9859-5c6ac725f94f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1725 microversion: 2.20 time: 0.498352 Sep 23 15:23:13.121900 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 204/382] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:12 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1725 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:23:13.127471 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-b4b578d2-1125-4114-a6ad-2a4f6647b3ed req-7e604f89-a384-4ac5-8e1d-52894c2501a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74b48a2a-0dde-4289-b8d6-788a66dafddb", "tag": "0c8439ba-0b08-4cad-8937-aa360e2a93ed"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:23:13.137301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-b4b578d2-1125-4114-a6ad-2a4f6647b3ed req-7e604f89-a384-4ac5-8e1d-52894c2501a0 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:13.138506 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-b4b578d2-1125-4114-a6ad-2a4f6647b3ed req-7e604f89-a384-4ac5-8e1d-52894c2501a0 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:13.139158 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-b4b578d2-1125-4114-a6ad-2a4f6647b3ed req-7e604f89-a384-4ac5-8e1d-52894c2501a0 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:13.150199 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-b4b578d2-1125-4114-a6ad-2a4f6647b3ed req-7e604f89-a384-4ac5-8e1d-52894c2501a0 service nova] Creating event network-changed:0c8439ba-0b08-4cad-8937-aa360e2a93ed for instance 74b48a2a-0dde-4289-b8d6-788a66dafddb on hv-cinder-85530 Sep 23 15:23:13.155682 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-b4b578d2-1125-4114-a6ad-2a4f6647b3ed req-7e604f89-a384-4ac5-8e1d-52894c2501a0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032606 Sep 23 15:23:13.156314 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 205/383] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:23:13.160071 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-e4e518f4-1c4c-4118-a0a4-fe16a30a7358 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:13.161485 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-be9e6e4b-1f66-42a7-b5e9-01c292091b97 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cb37291-1e02-43f5-8b81-d8b30293af64"}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:23:13.164189 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-be9e6e4b-1f66-42a7-b5e9-01c292091b97 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:13.168008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-e4e518f4-1c4c-4118-a0a4-fe16a30a7358 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1261 microversion: 2.1 time: 0.229628 Sep 23 15:23:13.168595 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 179/384] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:12 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1261 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:23:13.170257 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-be9e6e4b-1f66-42a7-b5e9-01c292091b97 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:13.170738 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-be9e6e4b-1f66-42a7-b5e9-01c292091b97 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:13.171165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-be9e6e4b-1f66-42a7-b5e9-01c292091b97 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:13.171852 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-be9e6e4b-1f66-42a7-b5e9-01c292091b97 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:13.172325 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-be9e6e4b-1f66-42a7-b5e9-01c292091b97 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:13.172742 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-be9e6e4b-1f66-42a7-b5e9-01c292091b97 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:13.666689 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-18b3c8a4-ff56-4445-aaf0-dec7a211ad79 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:13.667416 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-18b3c8a4-ff56-4445-aaf0-dec7a211ad79 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:13.670657 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell0:SELECT=16 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:13.708863 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-18b3c8a4-ff56-4445-aaf0-dec7a211ad79 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:13.709603 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-18b3c8a4-ff56-4445-aaf0-dec7a211ad79 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:13.710139 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-18b3c8a4-ff56-4445-aaf0-dec7a211ad79 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:13.711016 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-18b3c8a4-ff56-4445-aaf0-dec7a211ad79 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:13.711555 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-18b3c8a4-ff56-4445-aaf0-dec7a211ad79 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:13.712487 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-18b3c8a4-ff56-4445-aaf0-dec7a211ad79 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:13.859364 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-18b3c8a4-ff56-4445-aaf0-dec7a211ad79 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:13.869741 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-18b3c8a4-ff56-4445-aaf0-dec7a211ad79 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5" status: 200 len: 1508 microversion: 2.1 time: 0.208060 Sep 23 15:23:13.870417 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 180/385] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:13 2022] GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5 => generated 1508 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:23:14.196370 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-3ee0645e-dc67-4e2a-948a-f626526c3785 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:14.197193 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-3ee0645e-dc67-4e2a-948a-f626526c3785 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:14.210783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3ee0645e-dc67-4e2a-948a-f626526c3785 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:14.212394 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3ee0645e-dc67-4e2a-948a-f626526c3785 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:14.217429 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3ee0645e-dc67-4e2a-948a-f626526c3785 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:14.223155 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3ee0645e-dc67-4e2a-948a-f626526c3785 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:14.223155 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3ee0645e-dc67-4e2a-948a-f626526c3785 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:14.223155 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3ee0645e-dc67-4e2a-948a-f626526c3785 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:14.395530 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-3ee0645e-dc67-4e2a-948a-f626526c3785 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:14.403919 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-3ee0645e-dc67-4e2a-948a-f626526c3785 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1261 microversion: 2.1 time: 0.214783 Sep 23 15:23:14.404559 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 181/386] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:14 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1261 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:23:14.424667 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-725b8fa3-cb40-4502-9f78-36cbc23466f0 req-f0881bee-ca6c-4e6b-b014-5cd50e235379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bba6fdd-bec4-491e-81ba-f3a9863f72ca", "name": "network-vif-unplugged", "status": "completed", "tag": "8801bad0-f531-42e9-8015-b0d63a8e4f8e"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:23:14.434935 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-725b8fa3-cb40-4502-9f78-36cbc23466f0 req-f0881bee-ca6c-4e6b-b014-5cd50e235379 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:14.436239 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-725b8fa3-cb40-4502-9f78-36cbc23466f0 req-f0881bee-ca6c-4e6b-b014-5cd50e235379 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:14.437070 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-725b8fa3-cb40-4502-9f78-36cbc23466f0 req-f0881bee-ca6c-4e6b-b014-5cd50e235379 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:14.449431 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.compute.server_external_events [req-725b8fa3-cb40-4502-9f78-36cbc23466f0 req-f0881bee-ca6c-4e6b-b014-5cd50e235379 service nova] Unable to find a host for instance 4bba6fdd-bec4-491e-81ba-f3a9863f72ca. Dropping event network-vif-unplugged {{(pid=121448) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 23 15:23:14.451077 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-725b8fa3-cb40-4502-9f78-36cbc23466f0 req-f0881bee-ca6c-4e6b-b014-5cd50e235379 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030205 Sep 23 15:23:14.452235 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 182/387] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 23 15:23:15.427148 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-c07e5307-a4eb-429b-843d-d3779d039f07 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:15.428284 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-c07e5307-a4eb-429b-843d-d3779d039f07 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:15.435353 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c07e5307-a4eb-429b-843d-d3779d039f07 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:15.436001 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c07e5307-a4eb-429b-843d-d3779d039f07 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:15.436608 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c07e5307-a4eb-429b-843d-d3779d039f07 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:15.437361 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c07e5307-a4eb-429b-843d-d3779d039f07 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:15.437890 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c07e5307-a4eb-429b-843d-d3779d039f07 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:15.438415 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c07e5307-a4eb-429b-843d-d3779d039f07 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:15.456369 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-be9e6e4b-1f66-42a7-b5e9-01c292091b97 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "POST /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 2.298630 Sep 23 15:23:15.457375 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 206/388] 10.222.0.55 () {62 vars in 1364 bytes} [Fri Sep 23 15:23:13 2022] POST /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca/os-volume_attachments => generated 188 bytes in 2300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:23:15.610353 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-8f2b01f8-61ad-43bc-a729-c2095dde3298 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:23:15.611013 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-8f2b01f8-61ad-43bc-a729-c2095dde3298 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:15.617328 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8f2b01f8-61ad-43bc-a729-c2095dde3298 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:15.618255 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8f2b01f8-61ad-43bc-a729-c2095dde3298 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:15.619012 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8f2b01f8-61ad-43bc-a729-c2095dde3298 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:15.619725 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8f2b01f8-61ad-43bc-a729-c2095dde3298 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:15.620224 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8f2b01f8-61ad-43bc-a729-c2095dde3298 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:15.620334 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-c07e5307-a4eb-429b-843d-d3779d039f07 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:15.620654 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8f2b01f8-61ad-43bc-a729-c2095dde3298 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:15.630169 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-c07e5307-a4eb-429b-843d-d3779d039f07 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1261 microversion: 2.1 time: 0.207271 Sep 23 15:23:15.631343 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 183/389] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:15 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1261 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:23:15.678134 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-8f2b01f8-61ad-43bc-a729-c2095dde3298 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121450) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 23 15:23:16.094439 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-8f2b01f8-61ad-43bc-a729-c2095dde3298 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "POST /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca/action" status: 202 len: 0 microversion: 2.20 time: 0.488542 Sep 23 15:23:16.095048 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 207/390] 10.222.0.55 () {62 vars in 1319 bytes} [Fri Sep 23 15:23:15 2022] POST /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 23 15:23:16.103628 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-027fe555-7362-48e7-906c-ee74c1d05430 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:16.104606 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-027fe555-7362-48e7-906c-ee74c1d05430 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:16.113077 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-027fe555-7362-48e7-906c-ee74c1d05430 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:16.113565 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-027fe555-7362-48e7-906c-ee74c1d05430 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:16.114005 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-027fe555-7362-48e7-906c-ee74c1d05430 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:16.114737 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-027fe555-7362-48e7-906c-ee74c1d05430 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:16.115191 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-027fe555-7362-48e7-906c-ee74c1d05430 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:16.115638 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-027fe555-7362-48e7-906c-ee74c1d05430 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:16.255174 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-027fe555-7362-48e7-906c-ee74c1d05430 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:16.264164 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-027fe555-7362-48e7-906c-ee74c1d05430 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:16.265609 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-027fe555-7362-48e7-906c-ee74c1d05430 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:16.268107 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-027fe555-7362-48e7-906c-ee74c1d05430 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1751 microversion: 2.20 time: 0.167489 Sep 23 15:23:16.268107 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 184/391] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:16 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:16.656327 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-f234b42a-c0ca-4fed-95d8-4f4bed30c97d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:16.657099 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-f234b42a-c0ca-4fed-95d8-4f4bed30c97d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:16.663868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f234b42a-c0ca-4fed-95d8-4f4bed30c97d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:16.669274 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f234b42a-c0ca-4fed-95d8-4f4bed30c97d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:16.669274 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f234b42a-c0ca-4fed-95d8-4f4bed30c97d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:16.669274 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f234b42a-c0ca-4fed-95d8-4f4bed30c97d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:16.669274 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f234b42a-c0ca-4fed-95d8-4f4bed30c97d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:16.669686 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f234b42a-c0ca-4fed-95d8-4f4bed30c97d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:16.818493 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-f234b42a-c0ca-4fed-95d8-4f4bed30c97d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:16.829434 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-f234b42a-c0ca-4fed-95d8-4f4bed30c97d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1261 microversion: 2.1 time: 0.175804 Sep 23 15:23:16.840480 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 208/392] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:16 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1261 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:17.292872 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-23dd9a73-6a49-40f3-9986-c54464bc9a74 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:17.294219 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-23dd9a73-6a49-40f3-9986-c54464bc9a74 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:17.300692 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-23dd9a73-6a49-40f3-9986-c54464bc9a74 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:17.301173 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-23dd9a73-6a49-40f3-9986-c54464bc9a74 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:17.301664 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-23dd9a73-6a49-40f3-9986-c54464bc9a74 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:17.302435 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-23dd9a73-6a49-40f3-9986-c54464bc9a74 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:17.302887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-23dd9a73-6a49-40f3-9986-c54464bc9a74 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:17.303306 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-23dd9a73-6a49-40f3-9986-c54464bc9a74 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:17.439906 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-23dd9a73-6a49-40f3-9986-c54464bc9a74 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:17.448082 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-23dd9a73-6a49-40f3-9986-c54464bc9a74 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:17.449688 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-23dd9a73-6a49-40f3-9986-c54464bc9a74 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:17.451615 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-23dd9a73-6a49-40f3-9986-c54464bc9a74 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1751 microversion: 2.20 time: 0.162666 Sep 23 15:23:17.453127 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 185/393] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:17 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:17.855169 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-7b1de080-bcf2-4a22-8a50-39f96fcf090a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:17.858485 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-7b1de080-bcf2-4a22-8a50-39f96fcf090a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:17.868852 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7b1de080-bcf2-4a22-8a50-39f96fcf090a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:17.870172 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7b1de080-bcf2-4a22-8a50-39f96fcf090a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:17.871354 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7b1de080-bcf2-4a22-8a50-39f96fcf090a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:17.874144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7b1de080-bcf2-4a22-8a50-39f96fcf090a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:17.874997 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7b1de080-bcf2-4a22-8a50-39f96fcf090a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:17.876540 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7b1de080-bcf2-4a22-8a50-39f96fcf090a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:18.058288 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-7b1de080-bcf2-4a22-8a50-39f96fcf090a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:18.079260 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-7b1de080-bcf2-4a22-8a50-39f96fcf090a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1261 microversion: 2.1 time: 0.229962 Sep 23 15:23:18.080450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 209/394] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:17 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1261 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:18.479580 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-8e0d1320-d713-44d8-8b7d-495a7d6d6a9b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:18.480203 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-8e0d1320-d713-44d8-8b7d-495a7d6d6a9b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:18.486429 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8e0d1320-d713-44d8-8b7d-495a7d6d6a9b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:18.486912 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8e0d1320-d713-44d8-8b7d-495a7d6d6a9b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:18.487340 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8e0d1320-d713-44d8-8b7d-495a7d6d6a9b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:18.488066 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8e0d1320-d713-44d8-8b7d-495a7d6d6a9b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:18.488523 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8e0d1320-d713-44d8-8b7d-495a7d6d6a9b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:18.488939 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8e0d1320-d713-44d8-8b7d-495a7d6d6a9b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:18.694699 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-8e0d1320-d713-44d8-8b7d-495a7d6d6a9b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:18.706396 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-8e0d1320-d713-44d8-8b7d-495a7d6d6a9b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:18.707842 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-8e0d1320-d713-44d8-8b7d-495a7d6d6a9b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:18.709049 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-8e0d1320-d713-44d8-8b7d-495a7d6d6a9b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1751 microversion: 2.20 time: 0.233451 Sep 23 15:23:18.709611 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 186/395] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:18 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1751 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:19.119127 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-96c81379-8ccb-4e55-be9c-1162e4997dfa tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:19.119127 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-96c81379-8ccb-4e55-be9c-1162e4997dfa tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:19.132717 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-96c81379-8ccb-4e55-be9c-1162e4997dfa tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:19.136793 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-96c81379-8ccb-4e55-be9c-1162e4997dfa tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:19.140088 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-96c81379-8ccb-4e55-be9c-1162e4997dfa tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:19.141298 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-96c81379-8ccb-4e55-be9c-1162e4997dfa tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:19.142050 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-96c81379-8ccb-4e55-be9c-1162e4997dfa tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:19.142678 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-96c81379-8ccb-4e55-be9c-1162e4997dfa tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:19.337440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-96c81379-8ccb-4e55-be9c-1162e4997dfa tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:19.349958 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-96c81379-8ccb-4e55-be9c-1162e4997dfa tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1261 microversion: 2.1 time: 0.248802 Sep 23 15:23:19.351956 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 210/396] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:19 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1261 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:19.738362 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-29aba3d4-d336-46dd-88d8-8992d3df8d47 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:19.739097 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-29aba3d4-d336-46dd-88d8-8992d3df8d47 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:19.745092 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-29aba3d4-d336-46dd-88d8-8992d3df8d47 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:19.755884 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-29aba3d4-d336-46dd-88d8-8992d3df8d47 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:19.755884 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-29aba3d4-d336-46dd-88d8-8992d3df8d47 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:19.755884 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-29aba3d4-d336-46dd-88d8-8992d3df8d47 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:19.755884 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-29aba3d4-d336-46dd-88d8-8992d3df8d47 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:19.756324 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-29aba3d4-d336-46dd-88d8-8992d3df8d47 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:19.889963 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-29aba3d4-d336-46dd-88d8-8992d3df8d47 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:19.898588 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-29aba3d4-d336-46dd-88d8-8992d3df8d47 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:19.900069 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-29aba3d4-d336-46dd-88d8-8992d3df8d47 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:19.901234 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-29aba3d4-d336-46dd-88d8-8992d3df8d47 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1753 microversion: 2.20 time: 0.167233 Sep 23 15:23:19.901794 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 187/397] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:19 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:20.373437 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-5a413d47-9629-46b6-bb63-36b21411e0b2 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:20.374045 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-5a413d47-9629-46b6-bb63-36b21411e0b2 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:20.381203 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5a413d47-9629-46b6-bb63-36b21411e0b2 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:20.381691 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5a413d47-9629-46b6-bb63-36b21411e0b2 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:20.382207 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5a413d47-9629-46b6-bb63-36b21411e0b2 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:20.382860 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5a413d47-9629-46b6-bb63-36b21411e0b2 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:20.383315 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5a413d47-9629-46b6-bb63-36b21411e0b2 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:20.383739 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5a413d47-9629-46b6-bb63-36b21411e0b2 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:20.388932 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:20.529662 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-5a413d47-9629-46b6-bb63-36b21411e0b2 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:20.537532 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-5a413d47-9629-46b6-bb63-36b21411e0b2 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1261 microversion: 2.1 time: 0.168100 Sep 23 15:23:20.538112 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 211/398] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:20 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:20.942041 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6aef982a-d76b-4f36-ac00-1d6c865a19a5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:20.942693 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-6aef982a-d76b-4f36-ac00-1d6c865a19a5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:20.951719 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6aef982a-d76b-4f36-ac00-1d6c865a19a5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:20.969254 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6aef982a-d76b-4f36-ac00-1d6c865a19a5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:20.969894 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6aef982a-d76b-4f36-ac00-1d6c865a19a5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:20.970895 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6aef982a-d76b-4f36-ac00-1d6c865a19a5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:20.971375 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6aef982a-d76b-4f36-ac00-1d6c865a19a5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:20.971808 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6aef982a-d76b-4f36-ac00-1d6c865a19a5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:21.127491 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6aef982a-d76b-4f36-ac00-1d6c865a19a5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:21.137526 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6aef982a-d76b-4f36-ac00-1d6c865a19a5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:21.139752 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6aef982a-d76b-4f36-ac00-1d6c865a19a5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:21.141983 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-6aef982a-d76b-4f36-ac00-1d6c865a19a5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1753 microversion: 2.20 time: 0.203936 Sep 23 15:23:21.142630 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 188/399] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:20 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1753 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:21.563714 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-fc884cd4-6143-41b2-82b8-3c96d754a897 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:21.564528 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-fc884cd4-6143-41b2-82b8-3c96d754a897 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:21.571466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fc884cd4-6143-41b2-82b8-3c96d754a897 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:21.572158 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fc884cd4-6143-41b2-82b8-3c96d754a897 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:21.572600 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fc884cd4-6143-41b2-82b8-3c96d754a897 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:21.573364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fc884cd4-6143-41b2-82b8-3c96d754a897 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:21.573840 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fc884cd4-6143-41b2-82b8-3c96d754a897 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:21.574248 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fc884cd4-6143-41b2-82b8-3c96d754a897 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:21.740280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-fc884cd4-6143-41b2-82b8-3c96d754a897 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:21.747648 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-fc884cd4-6143-41b2-82b8-3c96d754a897 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1261 microversion: 2.1 time: 0.188596 Sep 23 15:23:21.748422 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 212/400] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:21 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1261 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:22.169361 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-ce38a9c9-d40b-4f40-bc16-c72505b9e977 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:22.170113 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-ce38a9c9-d40b-4f40-bc16-c72505b9e977 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:22.177332 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ce38a9c9-d40b-4f40-bc16-c72505b9e977 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:22.177915 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ce38a9c9-d40b-4f40-bc16-c72505b9e977 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:22.178425 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ce38a9c9-d40b-4f40-bc16-c72505b9e977 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:22.179200 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ce38a9c9-d40b-4f40-bc16-c72505b9e977 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:22.179728 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ce38a9c9-d40b-4f40-bc16-c72505b9e977 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:22.180291 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ce38a9c9-d40b-4f40-bc16-c72505b9e977 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:22.356127 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-ce38a9c9-d40b-4f40-bc16-c72505b9e977 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:22.356127 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-ce38a9c9-d40b-4f40-bc16-c72505b9e977 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:22.356393 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-ce38a9c9-d40b-4f40-bc16-c72505b9e977 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:22.357843 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-ce38a9c9-d40b-4f40-bc16-c72505b9e977 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1809 microversion: 2.20 time: 0.193032 Sep 23 15:23:22.358410 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 189/401] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:22 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:22.771379 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-e07be06c-381e-4c4a-be24-30338b861178 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:22.772185 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-e07be06c-381e-4c4a-be24-30338b861178 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:22.783763 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e07be06c-381e-4c4a-be24-30338b861178 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:22.784405 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e07be06c-381e-4c4a-be24-30338b861178 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:22.785072 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e07be06c-381e-4c4a-be24-30338b861178 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:22.785935 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e07be06c-381e-4c4a-be24-30338b861178 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:22.786720 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e07be06c-381e-4c4a-be24-30338b861178 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:22.787278 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e07be06c-381e-4c4a-be24-30338b861178 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:23.171058 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-e07be06c-381e-4c4a-be24-30338b861178 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:23.179901 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-e07be06c-381e-4c4a-be24-30338b861178 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1261 microversion: 2.1 time: 0.412502 Sep 23 15:23:23.180554 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 213/402] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:22 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1261 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:23.383773 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-b6a33662-ce82-4bfc-9505-2c417a296b70 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:23.385558 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-b6a33662-ce82-4bfc-9505-2c417a296b70 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:23.393416 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b6a33662-ce82-4bfc-9505-2c417a296b70 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:23.394243 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b6a33662-ce82-4bfc-9505-2c417a296b70 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:23.394845 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b6a33662-ce82-4bfc-9505-2c417a296b70 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:23.395716 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b6a33662-ce82-4bfc-9505-2c417a296b70 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:23.396358 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b6a33662-ce82-4bfc-9505-2c417a296b70 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:23.398191 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b6a33662-ce82-4bfc-9505-2c417a296b70 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:23.567627 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b6a33662-ce82-4bfc-9505-2c417a296b70 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:23.583272 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b6a33662-ce82-4bfc-9505-2c417a296b70 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:23.583272 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b6a33662-ce82-4bfc-9505-2c417a296b70 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:23.583272 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-b6a33662-ce82-4bfc-9505-2c417a296b70 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1809 microversion: 2.20 time: 0.203804 Sep 23 15:23:23.583875 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 190/403] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:23 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:24.205229 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-9a03e308-4f7b-4556-81d9-5dc39fe82b1d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:24.205904 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-9a03e308-4f7b-4556-81d9-5dc39fe82b1d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:24.213278 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9a03e308-4f7b-4556-81d9-5dc39fe82b1d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:24.213760 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9a03e308-4f7b-4556-81d9-5dc39fe82b1d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:24.214269 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9a03e308-4f7b-4556-81d9-5dc39fe82b1d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:24.215231 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9a03e308-4f7b-4556-81d9-5dc39fe82b1d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:24.215842 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9a03e308-4f7b-4556-81d9-5dc39fe82b1d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:24.216437 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9a03e308-4f7b-4556-81d9-5dc39fe82b1d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:24.545881 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-9a03e308-4f7b-4556-81d9-5dc39fe82b1d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:24.554200 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-9a03e308-4f7b-4556-81d9-5dc39fe82b1d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1261 microversion: 2.1 time: 0.353776 Sep 23 15:23:24.555019 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 214/404] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:24 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1261 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:24.611139 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a385188e-d301-4c62-9642-d9b40e9aa92f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:24.612182 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-a385188e-d301-4c62-9642-d9b40e9aa92f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:24.620757 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a385188e-d301-4c62-9642-d9b40e9aa92f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:24.621466 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a385188e-d301-4c62-9642-d9b40e9aa92f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:24.622185 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a385188e-d301-4c62-9642-d9b40e9aa92f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:24.622887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a385188e-d301-4c62-9642-d9b40e9aa92f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:24.623416 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a385188e-d301-4c62-9642-d9b40e9aa92f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:24.623933 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a385188e-d301-4c62-9642-d9b40e9aa92f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:24.789373 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a385188e-d301-4c62-9642-d9b40e9aa92f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:24.810201 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a385188e-d301-4c62-9642-d9b40e9aa92f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:24.812322 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a385188e-d301-4c62-9642-d9b40e9aa92f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:24.813848 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-a385188e-d301-4c62-9642-d9b40e9aa92f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1809 microversion: 2.20 time: 0.206798 Sep 23 15:23:24.814898 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 191/405] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:24 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1809 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:25.584907 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-ff4a8e0a-b4f7-4da4-987c-7375ed17812b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:25.584907 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-ff4a8e0a-b4f7-4da4-987c-7375ed17812b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:25.601553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ff4a8e0a-b4f7-4da4-987c-7375ed17812b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:25.601553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ff4a8e0a-b4f7-4da4-987c-7375ed17812b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:25.601553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ff4a8e0a-b4f7-4da4-987c-7375ed17812b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:25.601553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ff4a8e0a-b4f7-4da4-987c-7375ed17812b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:25.601904 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ff4a8e0a-b4f7-4da4-987c-7375ed17812b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:25.601904 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ff4a8e0a-b4f7-4da4-987c-7375ed17812b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:25.792226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-ff4a8e0a-b4f7-4da4-987c-7375ed17812b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:25.801898 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-ff4a8e0a-b4f7-4da4-987c-7375ed17812b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1261 microversion: 2.1 time: 0.227496 Sep 23 15:23:25.804024 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 215/406] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:25 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1261 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:25.845713 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-0865aa93-a3b6-41f1-a0d2-a72bb603e80b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:25.846293 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-0865aa93-a3b6-41f1-a0d2-a72bb603e80b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:25.860697 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0865aa93-a3b6-41f1-a0d2-a72bb603e80b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:25.864735 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0865aa93-a3b6-41f1-a0d2-a72bb603e80b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:25.864735 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0865aa93-a3b6-41f1-a0d2-a72bb603e80b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:25.864735 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0865aa93-a3b6-41f1-a0d2-a72bb603e80b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:25.864735 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0865aa93-a3b6-41f1-a0d2-a72bb603e80b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:25.865189 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0865aa93-a3b6-41f1-a0d2-a72bb603e80b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:25.892102 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=100 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:26.112957 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-0865aa93-a3b6-41f1-a0d2-a72bb603e80b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:26.124227 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-0865aa93-a3b6-41f1-a0d2-a72bb603e80b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:26.126622 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-0865aa93-a3b6-41f1-a0d2-a72bb603e80b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:26.128443 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-0865aa93-a3b6-41f1-a0d2-a72bb603e80b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1809 microversion: 2.20 time: 0.288598 Sep 23 15:23:26.129318 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 192/407] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:25 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1809 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:26.674523 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-2002fa95-0884-41f8-aff4-46c79b7a767d req-8a1cd3d3-e15d-478c-b697-da7175c6bc32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74b48a2a-0dde-4289-b8d6-788a66dafddb", "name": "network-vif-plugged", "status": "completed", "tag": "0c8439ba-0b08-4cad-8937-aa360e2a93ed"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:23:26.693619 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-2002fa95-0884-41f8-aff4-46c79b7a767d req-8a1cd3d3-e15d-478c-b697-da7175c6bc32 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:26.694505 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-2002fa95-0884-41f8-aff4-46c79b7a767d req-8a1cd3d3-e15d-478c-b697-da7175c6bc32 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:26.696929 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-2002fa95-0884-41f8-aff4-46c79b7a767d req-8a1cd3d3-e15d-478c-b697-da7175c6bc32 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:26.729674 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-2002fa95-0884-41f8-aff4-46c79b7a767d req-8a1cd3d3-e15d-478c-b697-da7175c6bc32 service nova] Creating event network-vif-plugged:0c8439ba-0b08-4cad-8937-aa360e2a93ed for instance 74b48a2a-0dde-4289-b8d6-788a66dafddb on hv-cinder-85530 Sep 23 15:23:26.737072 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-2002fa95-0884-41f8-aff4-46c79b7a767d req-8a1cd3d3-e15d-478c-b697-da7175c6bc32 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066196 Sep 23 15:23:26.737950 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 216/408] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:23:26.834263 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-ce42fcba-59c6-4bae-a3ea-13404a9685c9 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:26.841207 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-ce42fcba-59c6-4bae-a3ea-13404a9685c9 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:26.854232 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ce42fcba-59c6-4bae-a3ea-13404a9685c9 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:26.857579 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ce42fcba-59c6-4bae-a3ea-13404a9685c9 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:26.860053 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ce42fcba-59c6-4bae-a3ea-13404a9685c9 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:26.865829 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ce42fcba-59c6-4bae-a3ea-13404a9685c9 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:26.865829 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ce42fcba-59c6-4bae-a3ea-13404a9685c9 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:26.865829 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ce42fcba-59c6-4bae-a3ea-13404a9685c9 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:27.160170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-719f5e27-1933-4215-80b3-92f1abf8b138 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:27.161161 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-719f5e27-1933-4215-80b3-92f1abf8b138 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:27.172854 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:27.176639 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-719f5e27-1933-4215-80b3-92f1abf8b138 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:27.178012 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-719f5e27-1933-4215-80b3-92f1abf8b138 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:27.178674 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-719f5e27-1933-4215-80b3-92f1abf8b138 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:27.179643 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-719f5e27-1933-4215-80b3-92f1abf8b138 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:27.180371 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-719f5e27-1933-4215-80b3-92f1abf8b138 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:27.181039 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-719f5e27-1933-4215-80b3-92f1abf8b138 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:27.307264 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-ce42fcba-59c6-4bae-a3ea-13404a9685c9 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:27.321032 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-ce42fcba-59c6-4bae-a3ea-13404a9685c9 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1261 microversion: 2.1 time: 0.493251 Sep 23 15:23:27.336476 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 193/409] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:26 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1261 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:27.562648 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-719f5e27-1933-4215-80b3-92f1abf8b138 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:27.569787 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-719f5e27-1933-4215-80b3-92f1abf8b138 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:27.571250 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-719f5e27-1933-4215-80b3-92f1abf8b138 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:27.573258 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-719f5e27-1933-4215-80b3-92f1abf8b138 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1809 microversion: 2.20 time: 0.417890 Sep 23 15:23:27.575038 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 217/410] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:27 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1809 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:28.350755 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-f79e3318-2059-4064-aaf4-0783018306f4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:28.354702 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-f79e3318-2059-4064-aaf4-0783018306f4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:28.364448 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f79e3318-2059-4064-aaf4-0783018306f4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:28.365888 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f79e3318-2059-4064-aaf4-0783018306f4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:28.366862 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f79e3318-2059-4064-aaf4-0783018306f4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:28.368319 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f79e3318-2059-4064-aaf4-0783018306f4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:28.369363 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f79e3318-2059-4064-aaf4-0783018306f4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:28.370078 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f79e3318-2059-4064-aaf4-0783018306f4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:28.604871 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a5958f6d-8462-4bc9-95d9-c310c0b7388d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:28.612997 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-a5958f6d-8462-4bc9-95d9-c310c0b7388d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:28.641614 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a5958f6d-8462-4bc9-95d9-c310c0b7388d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:28.642533 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a5958f6d-8462-4bc9-95d9-c310c0b7388d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:28.643241 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a5958f6d-8462-4bc9-95d9-c310c0b7388d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:28.651134 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a5958f6d-8462-4bc9-95d9-c310c0b7388d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:28.652148 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a5958f6d-8462-4bc9-95d9-c310c0b7388d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:28.652824 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a5958f6d-8462-4bc9-95d9-c310c0b7388d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:28.788966 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-f79e3318-2059-4064-aaf4-0783018306f4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:28.805967 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-f79e3318-2059-4064-aaf4-0783018306f4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1261 microversion: 2.1 time: 0.462177 Sep 23 15:23:28.811399 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 194/411] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:28 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1261 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:29.031788 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a5958f6d-8462-4bc9-95d9-c310c0b7388d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:29.042314 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a5958f6d-8462-4bc9-95d9-c310c0b7388d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:29.043901 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a5958f6d-8462-4bc9-95d9-c310c0b7388d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:29.053626 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-a5958f6d-8462-4bc9-95d9-c310c0b7388d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1809 microversion: 2.20 time: 0.454796 Sep 23 15:23:29.068470 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 218/412] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:28 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1809 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:23:29.836041 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-ef789cfe-62eb-40c0-8111-7665a711e0e8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:29.837341 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-ef789cfe-62eb-40c0-8111-7665a711e0e8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:29.846100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ef789cfe-62eb-40c0-8111-7665a711e0e8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:29.846938 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ef789cfe-62eb-40c0-8111-7665a711e0e8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:29.847668 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ef789cfe-62eb-40c0-8111-7665a711e0e8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:29.848930 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ef789cfe-62eb-40c0-8111-7665a711e0e8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:29.849591 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ef789cfe-62eb-40c0-8111-7665a711e0e8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:29.850215 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ef789cfe-62eb-40c0-8111-7665a711e0e8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:30.047264 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-ef789cfe-62eb-40c0-8111-7665a711e0e8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:30.057168 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-ef789cfe-62eb-40c0-8111-7665a711e0e8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1261 microversion: 2.1 time: 0.225552 Sep 23 15:23:30.059199 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 195/413] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:29 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1261 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:30.084125 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-436eabab-cebd-4294-ae40-696571733464 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:30.084729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-436eabab-cebd-4294-ae40-696571733464 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:30.093896 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-436eabab-cebd-4294-ae40-696571733464 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:30.094399 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-436eabab-cebd-4294-ae40-696571733464 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:30.094839 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-436eabab-cebd-4294-ae40-696571733464 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:30.095547 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-436eabab-cebd-4294-ae40-696571733464 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:30.097946 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-436eabab-cebd-4294-ae40-696571733464 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:30.098388 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-436eabab-cebd-4294-ae40-696571733464 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:30.288979 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-436eabab-cebd-4294-ae40-696571733464 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:30.298619 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-436eabab-cebd-4294-ae40-696571733464 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:30.300104 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-436eabab-cebd-4294-ae40-696571733464 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:30.301278 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-436eabab-cebd-4294-ae40-696571733464 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1809 microversion: 2.20 time: 0.221099 Sep 23 15:23:30.302025 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 219/414] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:30 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1809 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:31.088354 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-5d57c202-e73f-4895-a5c8-ce4cfb2df2ce tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:31.089038 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-5d57c202-e73f-4895-a5c8-ce4cfb2df2ce tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:31.100618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 15:23:31.104118 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Fri Sep 23 15:23:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb (ip 10.222.0.55) !!! Sep 23 15:23:31.109108 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5d57c202-e73f-4895-a5c8-ce4cfb2df2ce tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:31.120755 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5d57c202-e73f-4895-a5c8-ce4cfb2df2ce tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:31.123937 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5d57c202-e73f-4895-a5c8-ce4cfb2df2ce tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:31.125268 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5d57c202-e73f-4895-a5c8-ce4cfb2df2ce tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:31.126510 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5d57c202-e73f-4895-a5c8-ce4cfb2df2ce tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:31.128133 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5d57c202-e73f-4895-a5c8-ce4cfb2df2ce tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:31.330272 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-07d09182-04ef-4169-83f8-2b23c7cbbf72 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:31.331660 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-07d09182-04ef-4169-83f8-2b23c7cbbf72 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:31.345979 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-07d09182-04ef-4169-83f8-2b23c7cbbf72 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:31.346475 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-07d09182-04ef-4169-83f8-2b23c7cbbf72 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:31.346915 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-07d09182-04ef-4169-83f8-2b23c7cbbf72 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:31.359111 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-5d57c202-e73f-4895-a5c8-ce4cfb2df2ce tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:31.360292 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-07d09182-04ef-4169-83f8-2b23c7cbbf72 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:31.360962 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-07d09182-04ef-4169-83f8-2b23c7cbbf72 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:31.361416 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-07d09182-04ef-4169-83f8-2b23c7cbbf72 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:31.373046 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-5d57c202-e73f-4895-a5c8-ce4cfb2df2ce tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1261 microversion: 2.1 time: 0.286497 Sep 23 15:23:31.373046 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 196/415] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:31 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1261 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:31.618840 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-07d09182-04ef-4169-83f8-2b23c7cbbf72 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:31.627780 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-07d09182-04ef-4169-83f8-2b23c7cbbf72 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:31.629466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-07d09182-04ef-4169-83f8-2b23c7cbbf72 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:31.630939 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-07d09182-04ef-4169-83f8-2b23c7cbbf72 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1809 microversion: 2.20 time: 0.305185 Sep 23 15:23:31.631679 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 220/416] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:31 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1809 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:23:32.395022 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-3e6fdf87-50f1-4534-8c37-d1b15193e7be tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:32.399327 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-3e6fdf87-50f1-4534-8c37-d1b15193e7be tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:32.403013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3e6fdf87-50f1-4534-8c37-d1b15193e7be tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:32.403482 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3e6fdf87-50f1-4534-8c37-d1b15193e7be tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:32.404071 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3e6fdf87-50f1-4534-8c37-d1b15193e7be tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:32.404711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3e6fdf87-50f1-4534-8c37-d1b15193e7be tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:32.405173 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3e6fdf87-50f1-4534-8c37-d1b15193e7be tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:32.405607 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3e6fdf87-50f1-4534-8c37-d1b15193e7be tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:32.605524 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-95b12fb3-a3d5-4d33-8f9d-36b14b5f281b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4e45e19-dd49-4cb5-ac88-ad010ec221b6"}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:23:32.608905 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-95b12fb3-a3d5-4d33-8f9d-36b14b5f281b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:32.623796 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-95b12fb3-a3d5-4d33-8f9d-36b14b5f281b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:32.625865 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-95b12fb3-a3d5-4d33-8f9d-36b14b5f281b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:32.626575 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-95b12fb3-a3d5-4d33-8f9d-36b14b5f281b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:32.628172 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-95b12fb3-a3d5-4d33-8f9d-36b14b5f281b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:32.628853 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-95b12fb3-a3d5-4d33-8f9d-36b14b5f281b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:32.629536 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-95b12fb3-a3d5-4d33-8f9d-36b14b5f281b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:32.734322 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-3e6fdf87-50f1-4534-8c37-d1b15193e7be tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:32.759432 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-3e6fdf87-50f1-4534-8c37-d1b15193e7be tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1261 microversion: 2.1 time: 0.366095 Sep 23 15:23:32.765815 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 197/417] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:32 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1261 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:32.784595 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-4587acda-ce25-4534-a863-2dbfce859f07 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:32.785392 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-4587acda-ce25-4534-a863-2dbfce859f07 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:32.796991 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4587acda-ce25-4534-a863-2dbfce859f07 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:32.798293 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4587acda-ce25-4534-a863-2dbfce859f07 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:32.799121 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4587acda-ce25-4534-a863-2dbfce859f07 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:32.803099 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4587acda-ce25-4534-a863-2dbfce859f07 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:32.803822 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4587acda-ce25-4534-a863-2dbfce859f07 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:32.804968 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4587acda-ce25-4534-a863-2dbfce859f07 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:33.143247 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-4587acda-ce25-4534-a863-2dbfce859f07 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:33.154525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-4587acda-ce25-4534-a863-2dbfce859f07 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:33.156691 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-4587acda-ce25-4534-a863-2dbfce859f07 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:33.158088 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-4587acda-ce25-4534-a863-2dbfce859f07 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1809 microversion: 2.20 time: 0.389582 Sep 23 15:23:33.159148 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 198/418] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:32 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1809 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:33.191479 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-c4518c6e-a0c8-4440-b4e7-fc8282769933 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0612a381-45ad-4844-aa42-91db13083322", "device": "/dev/sdb"}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:23:33.194882 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-c4518c6e-a0c8-4440-b4e7-fc8282769933 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:33.204615 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c4518c6e-a0c8-4440-b4e7-fc8282769933 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:33.205117 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c4518c6e-a0c8-4440-b4e7-fc8282769933 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:33.205618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c4518c6e-a0c8-4440-b4e7-fc8282769933 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:33.206334 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c4518c6e-a0c8-4440-b4e7-fc8282769933 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:33.206947 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c4518c6e-a0c8-4440-b4e7-fc8282769933 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:33.207444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c4518c6e-a0c8-4440-b4e7-fc8282769933 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:40.300928 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-c4518c6e-a0c8-4440-b4e7-fc8282769933 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "POST /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.140120 Sep 23 15:23:40.307238 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 199/419] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Sep 23 15:23:33 2022] POST /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5/os-volume_attachments => generated 194 bytes in 7147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:23:40.313730 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-22f36a57-8af3-408d-aa7d-cf35f7544639 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:40.314857 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-22f36a57-8af3-408d-aa7d-cf35f7544639 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:40.322769 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-22f36a57-8af3-408d-aa7d-cf35f7544639 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:40.323786 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-22f36a57-8af3-408d-aa7d-cf35f7544639 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:40.324480 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-22f36a57-8af3-408d-aa7d-cf35f7544639 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:40.325453 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-22f36a57-8af3-408d-aa7d-cf35f7544639 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:40.326176 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-22f36a57-8af3-408d-aa7d-cf35f7544639 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:40.326890 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-22f36a57-8af3-408d-aa7d-cf35f7544639 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:40.375350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-95b12fb3-a3d5-4d33-8f9d-36b14b5f281b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "POST /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.775779 Sep 23 15:23:40.381358 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 221/420] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Sep 23 15:23:32 2022] POST /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/os-volume_attachments => generated 194 bytes in 7778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:23:40.405537 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-0af78185-5ba2-4f6c-a332-6b3189a95cb9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:40.413071 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-0af78185-5ba2-4f6c-a332-6b3189a95cb9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:40.429445 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0af78185-5ba2-4f6c-a332-6b3189a95cb9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:40.431735 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0af78185-5ba2-4f6c-a332-6b3189a95cb9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:40.434894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0af78185-5ba2-4f6c-a332-6b3189a95cb9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:40.437686 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0af78185-5ba2-4f6c-a332-6b3189a95cb9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:40.438682 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0af78185-5ba2-4f6c-a332-6b3189a95cb9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:40.440197 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0af78185-5ba2-4f6c-a332-6b3189a95cb9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:40.637473 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-22f36a57-8af3-408d-aa7d-cf35f7544639 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:40.646074 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-22f36a57-8af3-408d-aa7d-cf35f7544639 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1261 microversion: 2.1 time: 0.337150 Sep 23 15:23:40.647276 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 200/421] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:40 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1261 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:40.701525 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-0af78185-5ba2-4f6c-a332-6b3189a95cb9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:40.711764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-0af78185-5ba2-4f6c-a332-6b3189a95cb9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:40.713464 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-0af78185-5ba2-4f6c-a332-6b3189a95cb9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:40.731466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-0af78185-5ba2-4f6c-a332-6b3189a95cb9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1809 microversion: 2.20 time: 0.353366 Sep 23 15:23:40.732632 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 222/422] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:40 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1809 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:41.673154 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-5c339c2f-c6ed-4a66-a1c8-661173b66b28 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:41.675270 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-5c339c2f-c6ed-4a66-a1c8-661173b66b28 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:41.681829 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_api:SELECT=54 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:41.683469 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5c339c2f-c6ed-4a66-a1c8-661173b66b28 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:41.684242 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5c339c2f-c6ed-4a66-a1c8-661173b66b28 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:41.684704 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5c339c2f-c6ed-4a66-a1c8-661173b66b28 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:41.685531 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5c339c2f-c6ed-4a66-a1c8-661173b66b28 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:41.686007 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5c339c2f-c6ed-4a66-a1c8-661173b66b28 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:41.686436 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5c339c2f-c6ed-4a66-a1c8-661173b66b28 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:41.767125 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-ff4810d5-b276-45b5-bb95-e4871d1d62de tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:41.771532 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-ff4810d5-b276-45b5-bb95-e4871d1d62de tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:41.808654 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ff4810d5-b276-45b5-bb95-e4871d1d62de tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:41.809906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ff4810d5-b276-45b5-bb95-e4871d1d62de tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:41.812629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ff4810d5-b276-45b5-bb95-e4871d1d62de tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:41.812629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ff4810d5-b276-45b5-bb95-e4871d1d62de tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:41.812629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ff4810d5-b276-45b5-bb95-e4871d1d62de tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:41.812629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ff4810d5-b276-45b5-bb95-e4871d1d62de tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:41.927159 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-5c339c2f-c6ed-4a66-a1c8-661173b66b28 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:41.938825 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-5c339c2f-c6ed-4a66-a1c8-661173b66b28 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1444 microversion: 2.1 time: 0.270300 Sep 23 15:23:41.939513 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 201/423] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:41 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1444 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:41.965066 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-edbc6672-b2f9-472a-884c-959702d6ff68 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:41.965700 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-edbc6672-b2f9-472a-884c-959702d6ff68 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:41.971653 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-edbc6672-b2f9-472a-884c-959702d6ff68 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:41.972187 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-edbc6672-b2f9-472a-884c-959702d6ff68 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:41.972644 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-edbc6672-b2f9-472a-884c-959702d6ff68 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:41.973425 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-edbc6672-b2f9-472a-884c-959702d6ff68 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:41.973853 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-edbc6672-b2f9-472a-884c-959702d6ff68 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:41.974288 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-edbc6672-b2f9-472a-884c-959702d6ff68 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:41.996863 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-ff4810d5-b276-45b5-bb95-e4871d1d62de tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:42.010250 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-ff4810d5-b276-45b5-bb95-e4871d1d62de tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:42.053386 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-ff4810d5-b276-45b5-bb95-e4871d1d62de tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:42.053386 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-ff4810d5-b276-45b5-bb95-e4871d1d62de tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1809 microversion: 2.20 time: 0.258272 Sep 23 15:23:42.053386 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 223/424] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:41 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1809 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:42.130307 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-edbc6672-b2f9-472a-884c-959702d6ff68 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:42.139617 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-edbc6672-b2f9-472a-884c-959702d6ff68 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1444 microversion: 2.1 time: 0.180325 Sep 23 15:23:42.140234 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 202/425] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:41 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1444 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:23:43.085526 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-19a41ac5-03e6-4432-b726-62f8c5570e7d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:43.086686 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-19a41ac5-03e6-4432-b726-62f8c5570e7d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:43.094678 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-19a41ac5-03e6-4432-b726-62f8c5570e7d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:43.097385 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-19a41ac5-03e6-4432-b726-62f8c5570e7d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:43.097385 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-19a41ac5-03e6-4432-b726-62f8c5570e7d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:43.097385 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-19a41ac5-03e6-4432-b726-62f8c5570e7d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:43.098068 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-19a41ac5-03e6-4432-b726-62f8c5570e7d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:43.098661 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-19a41ac5-03e6-4432-b726-62f8c5570e7d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:43.361229 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-19a41ac5-03e6-4432-b726-62f8c5570e7d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:43.374371 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-19a41ac5-03e6-4432-b726-62f8c5570e7d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:43.381527 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-19a41ac5-03e6-4432-b726-62f8c5570e7d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:43.381527 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-19a41ac5-03e6-4432-b726-62f8c5570e7d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1809 microversion: 2.20 time: 0.302115 Sep 23 15:23:43.381527 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 224/426] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:43 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1809 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:44.406254 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-02506a50-8421-4e17-9ebe-975979ba82af tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:44.407569 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-02506a50-8421-4e17-9ebe-975979ba82af tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:44.414599 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-02506a50-8421-4e17-9ebe-975979ba82af tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:44.415114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-02506a50-8421-4e17-9ebe-975979ba82af tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:44.415555 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-02506a50-8421-4e17-9ebe-975979ba82af tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:44.416309 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-02506a50-8421-4e17-9ebe-975979ba82af tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:44.416771 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-02506a50-8421-4e17-9ebe-975979ba82af tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:44.418350 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-02506a50-8421-4e17-9ebe-975979ba82af tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:44.601809 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-02506a50-8421-4e17-9ebe-975979ba82af tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:44.613774 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-02506a50-8421-4e17-9ebe-975979ba82af tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:44.616693 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-02506a50-8421-4e17-9ebe-975979ba82af tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:44.619002 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-02506a50-8421-4e17-9ebe-975979ba82af tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1809 microversion: 2.20 time: 0.217217 Sep 23 15:23:44.621022 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 203/427] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:44 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:45.346772 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-9aeeb952-8fbd-404f-8321-28c7a8ddb2ef req-28024adf-2dd5-49aa-8b40-2486e2a7f23a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74b48a2a-0dde-4289-b8d6-788a66dafddb", "tag": "0c8439ba-0b08-4cad-8937-aa360e2a93ed"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:23:45.360794 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-9aeeb952-8fbd-404f-8321-28c7a8ddb2ef req-28024adf-2dd5-49aa-8b40-2486e2a7f23a service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:45.361524 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-9aeeb952-8fbd-404f-8321-28c7a8ddb2ef req-28024adf-2dd5-49aa-8b40-2486e2a7f23a service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:45.362105 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-9aeeb952-8fbd-404f-8321-28c7a8ddb2ef req-28024adf-2dd5-49aa-8b40-2486e2a7f23a service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:45.377206 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-9aeeb952-8fbd-404f-8321-28c7a8ddb2ef req-28024adf-2dd5-49aa-8b40-2486e2a7f23a service nova] Creating event network-changed:0c8439ba-0b08-4cad-8937-aa360e2a93ed for instance 74b48a2a-0dde-4289-b8d6-788a66dafddb on hv-cinder-85530 Sep 23 15:23:45.386644 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-9aeeb952-8fbd-404f-8321-28c7a8ddb2ef req-28024adf-2dd5-49aa-8b40-2486e2a7f23a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043519 Sep 23 15:23:45.387726 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 225/428] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:23:45.646545 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-8120102e-b7db-4098-84ab-04d4ad4d1bca tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:45.647993 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-8120102e-b7db-4098-84ab-04d4ad4d1bca tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:45.660097 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8120102e-b7db-4098-84ab-04d4ad4d1bca tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:45.661024 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8120102e-b7db-4098-84ab-04d4ad4d1bca tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:45.661703 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8120102e-b7db-4098-84ab-04d4ad4d1bca tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:45.662683 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8120102e-b7db-4098-84ab-04d4ad4d1bca tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:45.663371 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8120102e-b7db-4098-84ab-04d4ad4d1bca tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:45.664102 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8120102e-b7db-4098-84ab-04d4ad4d1bca tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:45.961690 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-8120102e-b7db-4098-84ab-04d4ad4d1bca tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:45.971816 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-8120102e-b7db-4098-84ab-04d4ad4d1bca tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:45.973385 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-8120102e-b7db-4098-84ab-04d4ad4d1bca tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:45.975117 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-8120102e-b7db-4098-84ab-04d4ad4d1bca tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1809 microversion: 2.20 time: 0.333144 Sep 23 15:23:45.976848 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 204/429] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:45 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1809 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:47.006233 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-d6eafd96-c83b-49e5-a8a0-c99cab357ca1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:47.006947 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-d6eafd96-c83b-49e5-a8a0-c99cab357ca1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:47.018125 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d6eafd96-c83b-49e5-a8a0-c99cab357ca1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:47.021531 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d6eafd96-c83b-49e5-a8a0-c99cab357ca1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:47.022359 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d6eafd96-c83b-49e5-a8a0-c99cab357ca1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:47.023135 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d6eafd96-c83b-49e5-a8a0-c99cab357ca1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:47.023827 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d6eafd96-c83b-49e5-a8a0-c99cab357ca1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:47.024467 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d6eafd96-c83b-49e5-a8a0-c99cab357ca1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:47.188300 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-d6eafd96-c83b-49e5-a8a0-c99cab357ca1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:47.198056 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-d6eafd96-c83b-49e5-a8a0-c99cab357ca1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:47.202363 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-d6eafd96-c83b-49e5-a8a0-c99cab357ca1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:47.202363 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-d6eafd96-c83b-49e5-a8a0-c99cab357ca1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1809 microversion: 2.20 time: 0.200110 Sep 23 15:23:47.202363 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 226/430] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:46 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:48.227153 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-d99cb4f1-104f-4e6a-af56-81273f875d87 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:48.232247 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-d99cb4f1-104f-4e6a-af56-81273f875d87 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:48.239442 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d99cb4f1-104f-4e6a-af56-81273f875d87 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:48.239921 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d99cb4f1-104f-4e6a-af56-81273f875d87 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:48.240404 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d99cb4f1-104f-4e6a-af56-81273f875d87 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:48.241370 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d99cb4f1-104f-4e6a-af56-81273f875d87 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:48.244519 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d99cb4f1-104f-4e6a-af56-81273f875d87 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:48.247077 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d99cb4f1-104f-4e6a-af56-81273f875d87 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:48.444061 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-d99cb4f1-104f-4e6a-af56-81273f875d87 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:48.459162 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-d99cb4f1-104f-4e6a-af56-81273f875d87 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:48.460681 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-d99cb4f1-104f-4e6a-af56-81273f875d87 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:48.461862 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-d99cb4f1-104f-4e6a-af56-81273f875d87 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1809 microversion: 2.20 time: 0.238785 Sep 23 15:23:48.462428 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 205/431] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:48 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1809 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:23:49.491704 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-20882f8f-ee76-475c-b3a6-4d39b132e578 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:49.500418 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-20882f8f-ee76-475c-b3a6-4d39b132e578 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:49.500418 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-20882f8f-ee76-475c-b3a6-4d39b132e578 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:49.500418 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-20882f8f-ee76-475c-b3a6-4d39b132e578 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:49.500739 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-20882f8f-ee76-475c-b3a6-4d39b132e578 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:49.501162 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-20882f8f-ee76-475c-b3a6-4d39b132e578 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:49.501611 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-20882f8f-ee76-475c-b3a6-4d39b132e578 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:49.502035 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-20882f8f-ee76-475c-b3a6-4d39b132e578 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:49.646704 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-20882f8f-ee76-475c-b3a6-4d39b132e578 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:49.650338 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:49.656165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-20882f8f-ee76-475c-b3a6-4d39b132e578 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:49.657603 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-20882f8f-ee76-475c-b3a6-4d39b132e578 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:49.658758 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-20882f8f-ee76-475c-b3a6-4d39b132e578 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1809 microversion: 2.20 time: 0.170999 Sep 23 15:23:49.659319 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 227/432] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:49 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:50.686925 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-be3dbb90-ec3b-402d-a0e2-29acd6cef323 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:50.687624 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-be3dbb90-ec3b-402d-a0e2-29acd6cef323 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:50.694552 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-be3dbb90-ec3b-402d-a0e2-29acd6cef323 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:50.695039 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-be3dbb90-ec3b-402d-a0e2-29acd6cef323 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:50.695489 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-be3dbb90-ec3b-402d-a0e2-29acd6cef323 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:50.696286 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-be3dbb90-ec3b-402d-a0e2-29acd6cef323 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:50.696750 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-be3dbb90-ec3b-402d-a0e2-29acd6cef323 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:50.697178 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-be3dbb90-ec3b-402d-a0e2-29acd6cef323 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:50.835246 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-be3dbb90-ec3b-402d-a0e2-29acd6cef323 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:50.844691 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-be3dbb90-ec3b-402d-a0e2-29acd6cef323 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:50.846141 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-be3dbb90-ec3b-402d-a0e2-29acd6cef323 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:50.847283 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-be3dbb90-ec3b-402d-a0e2-29acd6cef323 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1809 microversion: 2.20 time: 0.165459 Sep 23 15:23:50.847843 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 206/433] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:50 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:51.527401 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-bb945650-b31b-40a3-8508-30f0adbff616 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Action: 'create', calling method: .version_select at 0x7f82dbb273a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1577171453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF98lmfEveiEtEMyJY9Ot0AdONiuVjJxeW5gIeU28yXYqGPPwXgvI0b+9OxvgEh5G2gbWHNNLlNJuz0S5Lg9VZxdojZ6ii9R89vEBTohEagRSnPCZ8XYVWdQD/gIRUClng=="}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:23:51.544155 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-bb945650-b31b-40a3-8508-30f0adbff616 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Getting quotas for project efbab8ef4fbd4c61811d0fc046290937. Resources: {'key_pairs'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:23:51.548022 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-bb945650-b31b-40a3-8508-30f0adbff616 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Getting quotas for user deda513f4c6448368cfa79203cf0d8d8 and project efbab8ef4fbd4c61811d0fc046290937. Resources: {'key_pairs'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:23:51.629245 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-bb945650-b31b-40a3-8508-30f0adbff616 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.106156 Sep 23 15:23:51.629815 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 228/434] 10.222.0.55 () {60 vars in 1159 bytes} [Fri Sep 23 15:23:51 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:23:51.681880 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-64587a85-6823-4813-ba44-04b0a8d68e7c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-373120767", "imageRef": "cc9ba346-1f9e-458a-988f-244c7bc9f553", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1577171453", "networks": [{"uuid": "1624566e-6352-44cc-addd-b45ad50d85f9"}]}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:23:51.738164 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.network.neutron [None req-64587a85-6823-4813-ba44-04b0a8d68e7c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] validate_networks() for [('1624566e-6352-44cc-addd-b45ad50d85f9', None, None, None, None, None)] {{(pid=121448) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:23:51.874744 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-76a5e379-a700-4ee0-be9e-08d287968487 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:51.875476 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-76a5e379-a700-4ee0-be9e-08d287968487 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:51.882431 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-76a5e379-a700-4ee0-be9e-08d287968487 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:51.882881 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-76a5e379-a700-4ee0-be9e-08d287968487 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:51.883317 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-76a5e379-a700-4ee0-be9e-08d287968487 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:51.884040 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-76a5e379-a700-4ee0-be9e-08d287968487 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:51.884496 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-76a5e379-a700-4ee0-be9e-08d287968487 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:51.884924 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-76a5e379-a700-4ee0-be9e-08d287968487 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:52.023876 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-76a5e379-a700-4ee0-be9e-08d287968487 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:52.033837 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-76a5e379-a700-4ee0-be9e-08d287968487 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:52.035278 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-76a5e379-a700-4ee0-be9e-08d287968487 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:52.036524 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-76a5e379-a700-4ee0-be9e-08d287968487 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1809 microversion: 2.20 time: 0.165890 Sep 23 15:23:52.045676 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 229/435] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:51 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:23:52.125110 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-64587a85-6823-4813-ba44-04b0a8d68e7c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Flavor limits 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:23:52.125535 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-64587a85-6823-4813-ba44-04b0a8d68e7c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Image limits 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:23:52.126012 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-64587a85-6823-4813-ba44-04b0a8d68e7c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Flavor pref 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:23:52.126422 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-64587a85-6823-4813-ba44-04b0a8d68e7c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Image pref 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:23:52.126830 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-64587a85-6823-4813-ba44-04b0a8d68e7c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:23:52.136851 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-64587a85-6823-4813-ba44-04b0a8d68e7c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:52.137347 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-64587a85-6823-4813-ba44-04b0a8d68e7c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:52.137788 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-64587a85-6823-4813-ba44-04b0a8d68e7c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:52.138514 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-64587a85-6823-4813-ba44-04b0a8d68e7c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:52.138971 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-64587a85-6823-4813-ba44-04b0a8d68e7c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:52.139398 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-64587a85-6823-4813-ba44-04b0a8d68e7c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:52.156844 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-64587a85-6823-4813-ba44-04b0a8d68e7c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Getting quotas for project efbab8ef4fbd4c61811d0fc046290937. Resources: {'ram', 'instances', 'cores'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:23:52.160907 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-64587a85-6823-4813-ba44-04b0a8d68e7c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Getting quotas for user deda513f4c6448368cfa79203cf0d8d8 and project efbab8ef4fbd4c61811d0fc046290937. Resources: {'ram', 'instances', 'cores'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:23:52.172113 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-64587a85-6823-4813-ba44-04b0a8d68e7c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Going to run 1 instances... {{(pid=121448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:23:52.174331 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-64587a85-6823-4813-ba44-04b0a8d68e7c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cc9ba346-1f9e-458a-988f-244c7bc9f553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:23:52.343781 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-64587a85-6823-4813-ba44-04b0a8d68e7c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.665755 Sep 23 15:23:52.344682 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 207/436] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Sep 23 15:23:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:23:52.356944 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-c3c25eb9-0c2e-4077-b35f-750927e86641 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:52.357716 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-c3c25eb9-0c2e-4077-b35f-750927e86641 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:52.426845 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-c3c25eb9-0c2e-4077-b35f-750927e86641 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:52.436784 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-c3c25eb9-0c2e-4077-b35f-750927e86641 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1258 microversion: 2.1 time: 0.084585 Sep 23 15:23:52.437364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 230/437] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:52 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1258 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:23:52.594458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-70a55433-86ac-4a68-b05b-79bb45c0af95 req-4e20c414-0bcd-4d68-bb55-2607308eb011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bba6fdd-bec4-491e-81ba-f3a9863f72ca", "name": "network-vif-plugged", "status": "completed", "tag": "8801bad0-f531-42e9-8015-b0d63a8e4f8e"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:23:52.605278 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-70a55433-86ac-4a68-b05b-79bb45c0af95 req-4e20c414-0bcd-4d68-bb55-2607308eb011 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:52.605818 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-70a55433-86ac-4a68-b05b-79bb45c0af95 req-4e20c414-0bcd-4d68-bb55-2607308eb011 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:52.606306 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-70a55433-86ac-4a68-b05b-79bb45c0af95 req-4e20c414-0bcd-4d68-bb55-2607308eb011 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:52.616419 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-70a55433-86ac-4a68-b05b-79bb45c0af95 req-4e20c414-0bcd-4d68-bb55-2607308eb011 service nova] Creating event network-vif-plugged:8801bad0-f531-42e9-8015-b0d63a8e4f8e for instance 4bba6fdd-bec4-491e-81ba-f3a9863f72ca on hv-cinder-85530 Sep 23 15:23:52.622250 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-70a55433-86ac-4a68-b05b-79bb45c0af95 req-4e20c414-0bcd-4d68-bb55-2607308eb011 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031429 Sep 23 15:23:52.622889 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 208/438] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:23:53.067372 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-ef09ab4e-e67a-4e0f-b52c-7316f9ae14d0 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:53.068037 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-ef09ab4e-e67a-4e0f-b52c-7316f9ae14d0 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:53.075246 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ef09ab4e-e67a-4e0f-b52c-7316f9ae14d0 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:53.076059 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ef09ab4e-e67a-4e0f-b52c-7316f9ae14d0 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:53.076705 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ef09ab4e-e67a-4e0f-b52c-7316f9ae14d0 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:53.077665 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ef09ab4e-e67a-4e0f-b52c-7316f9ae14d0 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:53.078218 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ef09ab4e-e67a-4e0f-b52c-7316f9ae14d0 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:53.078744 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ef09ab4e-e67a-4e0f-b52c-7316f9ae14d0 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:53.214737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-ef09ab4e-e67a-4e0f-b52c-7316f9ae14d0 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:53.223575 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-ef09ab4e-e67a-4e0f-b52c-7316f9ae14d0 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:53.225058 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-ef09ab4e-e67a-4e0f-b52c-7316f9ae14d0 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:53.226268 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-ef09ab4e-e67a-4e0f-b52c-7316f9ae14d0 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1809 microversion: 2.20 time: 0.163476 Sep 23 15:23:53.226771 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 231/439] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:53 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:23:53.479275 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-47a7bb15-16e5-4e16-a0c8-430e0084b6e5 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:53.480118 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-47a7bb15-16e5-4e16-a0c8-430e0084b6e5 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:53.555452 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-47a7bb15-16e5-4e16-a0c8-430e0084b6e5 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:53.563254 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-47a7bb15-16e5-4e16-a0c8-430e0084b6e5 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1258 microversion: 2.1 time: 0.089269 Sep 23 15:23:53.563818 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 209/440] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:53 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1258 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:54.254624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a203dcb8-aa97-46fa-9589-6a09afc67d6b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:54.255227 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-a203dcb8-aa97-46fa-9589-6a09afc67d6b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:54.262617 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a203dcb8-aa97-46fa-9589-6a09afc67d6b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:54.263103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a203dcb8-aa97-46fa-9589-6a09afc67d6b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:54.263540 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a203dcb8-aa97-46fa-9589-6a09afc67d6b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:54.264390 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a203dcb8-aa97-46fa-9589-6a09afc67d6b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:54.264847 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a203dcb8-aa97-46fa-9589-6a09afc67d6b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:54.265271 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a203dcb8-aa97-46fa-9589-6a09afc67d6b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:54.400373 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a203dcb8-aa97-46fa-9589-6a09afc67d6b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:54.409587 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a203dcb8-aa97-46fa-9589-6a09afc67d6b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:54.411012 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a203dcb8-aa97-46fa-9589-6a09afc67d6b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:54.412196 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-a203dcb8-aa97-46fa-9589-6a09afc67d6b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1809 microversion: 2.20 time: 0.161748 Sep 23 15:23:54.412766 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 232/441] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:54 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:54.586004 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-c38deb2f-af12-4213-94d7-5ac13f7a28ca tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:54.586625 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-c38deb2f-af12-4213-94d7-5ac13f7a28ca tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:54.594024 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c38deb2f-af12-4213-94d7-5ac13f7a28ca tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:54.594507 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c38deb2f-af12-4213-94d7-5ac13f7a28ca tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:54.594947 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c38deb2f-af12-4213-94d7-5ac13f7a28ca tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:54.595696 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c38deb2f-af12-4213-94d7-5ac13f7a28ca tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:54.596128 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c38deb2f-af12-4213-94d7-5ac13f7a28ca tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:54.596563 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c38deb2f-af12-4213-94d7-5ac13f7a28ca tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:54.600686 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:54.656941 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-c38deb2f-af12-4213-94d7-5ac13f7a28ca tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:54.664530 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-c38deb2f-af12-4213-94d7-5ac13f7a28ca tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1262 microversion: 2.1 time: 0.082249 Sep 23 15:23:54.665044 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 210/442] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:54 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:55.438666 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-6a80f7b9-94e0-4e60-b92b-fece7feb8861 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:55.439217 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-6a80f7b9-94e0-4e60-b92b-fece7feb8861 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:55.445725 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6a80f7b9-94e0-4e60-b92b-fece7feb8861 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:55.446204 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6a80f7b9-94e0-4e60-b92b-fece7feb8861 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:55.446634 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6a80f7b9-94e0-4e60-b92b-fece7feb8861 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:55.447383 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6a80f7b9-94e0-4e60-b92b-fece7feb8861 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:55.447866 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6a80f7b9-94e0-4e60-b92b-fece7feb8861 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:55.448381 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6a80f7b9-94e0-4e60-b92b-fece7feb8861 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:55.584070 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-6a80f7b9-94e0-4e60-b92b-fece7feb8861 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:55.593473 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-6a80f7b9-94e0-4e60-b92b-fece7feb8861 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:55.594948 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-6a80f7b9-94e0-4e60-b92b-fece7feb8861 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:55.596196 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-6a80f7b9-94e0-4e60-b92b-fece7feb8861 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1809 microversion: 2.20 time: 0.161490 Sep 23 15:23:55.596749 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 233/443] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:55 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:55.689270 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-efe73ce8-b074-4f21-9b43-9dd471d40bf7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:55.689833 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-efe73ce8-b074-4f21-9b43-9dd471d40bf7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:55.696648 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-efe73ce8-b074-4f21-9b43-9dd471d40bf7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:55.697137 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-efe73ce8-b074-4f21-9b43-9dd471d40bf7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:55.697576 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-efe73ce8-b074-4f21-9b43-9dd471d40bf7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:55.698299 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-efe73ce8-b074-4f21-9b43-9dd471d40bf7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:55.698949 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-efe73ce8-b074-4f21-9b43-9dd471d40bf7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:55.699375 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-efe73ce8-b074-4f21-9b43-9dd471d40bf7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:55.764277 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-efe73ce8-b074-4f21-9b43-9dd471d40bf7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:55.771732 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-efe73ce8-b074-4f21-9b43-9dd471d40bf7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1262 microversion: 2.1 time: 0.086778 Sep 23 15:23:55.772327 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 211/444] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:55 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:56.623457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-108174ff-99d4-44a2-ad18-0ecb690c0e56 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:56.624094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-108174ff-99d4-44a2-ad18-0ecb690c0e56 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:56.631009 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-108174ff-99d4-44a2-ad18-0ecb690c0e56 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:56.631503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-108174ff-99d4-44a2-ad18-0ecb690c0e56 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:56.632011 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-108174ff-99d4-44a2-ad18-0ecb690c0e56 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:56.632796 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-108174ff-99d4-44a2-ad18-0ecb690c0e56 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:56.633255 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-108174ff-99d4-44a2-ad18-0ecb690c0e56 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:56.633679 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-108174ff-99d4-44a2-ad18-0ecb690c0e56 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:56.769613 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-108174ff-99d4-44a2-ad18-0ecb690c0e56 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:56.778794 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-108174ff-99d4-44a2-ad18-0ecb690c0e56 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:56.780171 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-108174ff-99d4-44a2-ad18-0ecb690c0e56 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:56.781332 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-108174ff-99d4-44a2-ad18-0ecb690c0e56 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1809 microversion: 2.20 time: 0.163186 Sep 23 15:23:56.781971 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 234/445] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:56 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:56.794089 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-9cb6ffd0-6891-4219-90ed-9a64790bdfc7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:56.794941 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-9cb6ffd0-6891-4219-90ed-9a64790bdfc7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:56.801335 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9cb6ffd0-6891-4219-90ed-9a64790bdfc7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:56.801866 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9cb6ffd0-6891-4219-90ed-9a64790bdfc7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:56.802390 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9cb6ffd0-6891-4219-90ed-9a64790bdfc7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:56.803078 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9cb6ffd0-6891-4219-90ed-9a64790bdfc7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:56.803532 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9cb6ffd0-6891-4219-90ed-9a64790bdfc7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:56.803961 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9cb6ffd0-6891-4219-90ed-9a64790bdfc7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:56.867610 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-9cb6ffd0-6891-4219-90ed-9a64790bdfc7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:56.875915 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-9cb6ffd0-6891-4219-90ed-9a64790bdfc7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1262 microversion: 2.1 time: 0.085490 Sep 23 15:23:56.876571 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 212/446] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:56 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:56.944900 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-d541d1a7-a779-4f88-85bf-d8d29a624df0 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:56.945398 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-d541d1a7-a779-4f88-85bf-d8d29a624df0 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:56.954820 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d541d1a7-a779-4f88-85bf-d8d29a624df0 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:56.955310 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d541d1a7-a779-4f88-85bf-d8d29a624df0 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:56.955749 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d541d1a7-a779-4f88-85bf-d8d29a624df0 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:56.956628 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d541d1a7-a779-4f88-85bf-d8d29a624df0 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:56.957360 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d541d1a7-a779-4f88-85bf-d8d29a624df0 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:56.958039 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d541d1a7-a779-4f88-85bf-d8d29a624df0 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:57.087277 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.objects.instance [None req-d541d1a7-a779-4f88-85bf-d8d29a624df0 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lazy-loading 'services' on Instance uuid 1c5523ab-9085-47cd-9133-f65554b59f0f {{(pid=121450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:23:57.626780 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-d541d1a7-a779-4f88-85bf-d8d29a624df0 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "DELETE /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f/os-volume_attachments/2be6f895-4a33-4397-981b-58254329fc95" status: 202 len: 0 microversion: 2.1 time: 0.685745 Sep 23 15:23:57.627608 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 235/447] 10.222.0.55 () {58 vars in 1416 bytes} [Fri Sep 23 15:23:56 2022] DELETE /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f/os-volume_attachments/2be6f895-4a33-4397-981b-58254329fc95 => generated 0 bytes in 687 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 15:23:57.813703 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-96b2e8f1-4617-4161-b177-3cd6b3d24314 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:57.814320 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-96b2e8f1-4617-4161-b177-3cd6b3d24314 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:57.820930 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-96b2e8f1-4617-4161-b177-3cd6b3d24314 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:57.821415 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-96b2e8f1-4617-4161-b177-3cd6b3d24314 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:57.821858 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-96b2e8f1-4617-4161-b177-3cd6b3d24314 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:57.822552 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-96b2e8f1-4617-4161-b177-3cd6b3d24314 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:57.823079 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-96b2e8f1-4617-4161-b177-3cd6b3d24314 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:57.823447 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-96b2e8f1-4617-4161-b177-3cd6b3d24314 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:57.900582 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-5686862a-6620-404e-8562-96dfe7922eaf tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:57.901440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-5686862a-6620-404e-8562-96dfe7922eaf tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:57.910348 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5686862a-6620-404e-8562-96dfe7922eaf tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:57.910348 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5686862a-6620-404e-8562-96dfe7922eaf tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:57.910348 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5686862a-6620-404e-8562-96dfe7922eaf tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:57.910348 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5686862a-6620-404e-8562-96dfe7922eaf tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:57.910807 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5686862a-6620-404e-8562-96dfe7922eaf tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:57.911013 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5686862a-6620-404e-8562-96dfe7922eaf tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:57.966438 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-96b2e8f1-4617-4161-b177-3cd6b3d24314 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:57.975589 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-96b2e8f1-4617-4161-b177-3cd6b3d24314 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:57.977061 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-96b2e8f1-4617-4161-b177-3cd6b3d24314 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:57.978222 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-96b2e8f1-4617-4161-b177-3cd6b3d24314 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1809 microversion: 2.20 time: 0.168609 Sep 23 15:23:57.980684 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 213/448] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:57 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:58.019395 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-5686862a-6620-404e-8562-96dfe7922eaf tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:58.027673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-5686862a-6620-404e-8562-96dfe7922eaf tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1254 microversion: 2.1 time: 0.132178 Sep 23 15:23:58.028271 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 236/449] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:57 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1254 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:23:59.006895 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-628cd7a4-a710-45a7-95dd-0ff109b51691 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:59.007506 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-628cd7a4-a710-45a7-95dd-0ff109b51691 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:59.015028 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-628cd7a4-a710-45a7-95dd-0ff109b51691 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:59.015513 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-628cd7a4-a710-45a7-95dd-0ff109b51691 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:59.015952 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-628cd7a4-a710-45a7-95dd-0ff109b51691 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:59.016672 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-628cd7a4-a710-45a7-95dd-0ff109b51691 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:59.017127 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-628cd7a4-a710-45a7-95dd-0ff109b51691 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:59.017555 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-628cd7a4-a710-45a7-95dd-0ff109b51691 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:59.050503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-e29f9251-42da-4c9f-921a-3dc9623f27ea tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:59.051114 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-e29f9251-42da-4c9f-921a-3dc9623f27ea tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:59.058686 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e29f9251-42da-4c9f-921a-3dc9623f27ea tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:59.059474 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e29f9251-42da-4c9f-921a-3dc9623f27ea tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:59.064800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e29f9251-42da-4c9f-921a-3dc9623f27ea tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:59.064800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e29f9251-42da-4c9f-921a-3dc9623f27ea tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:59.064800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e29f9251-42da-4c9f-921a-3dc9623f27ea tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:59.064800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e29f9251-42da-4c9f-921a-3dc9623f27ea tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:59.126130 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-e29f9251-42da-4c9f-921a-3dc9623f27ea tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:59.133919 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-e29f9251-42da-4c9f-921a-3dc9623f27ea tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1310 microversion: 2.1 time: 0.087182 Sep 23 15:23:59.134483 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 237/450] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:59 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1310 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:23:59.158896 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-628cd7a4-a710-45a7-95dd-0ff109b51691 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:59.168242 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-628cd7a4-a710-45a7-95dd-0ff109b51691 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:59.169722 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-628cd7a4-a710-45a7-95dd-0ff109b51691 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:59.170880 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-628cd7a4-a710-45a7-95dd-0ff109b51691 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1809 microversion: 2.20 time: 0.168198 Sep 23 15:23:59.171438 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 214/451] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:59 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:24:00.157952 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-da08cca3-bc83-41eb-b091-fcda1676f0bb tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:00.158565 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-da08cca3-bc83-41eb-b091-fcda1676f0bb tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:00.161106 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:00.165988 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-da08cca3-bc83-41eb-b091-fcda1676f0bb tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:00.167203 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-da08cca3-bc83-41eb-b091-fcda1676f0bb tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:00.167725 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-da08cca3-bc83-41eb-b091-fcda1676f0bb tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:00.168449 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-da08cca3-bc83-41eb-b091-fcda1676f0bb tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:00.168907 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-da08cca3-bc83-41eb-b091-fcda1676f0bb tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:00.169401 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-da08cca3-bc83-41eb-b091-fcda1676f0bb tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:00.195834 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-8295e173-f589-4e30-856e-8b326384c033 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:00.196466 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-8295e173-f589-4e30-856e-8b326384c033 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:00.203308 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8295e173-f589-4e30-856e-8b326384c033 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:00.203795 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8295e173-f589-4e30-856e-8b326384c033 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:00.204264 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8295e173-f589-4e30-856e-8b326384c033 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:00.204966 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8295e173-f589-4e30-856e-8b326384c033 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:00.205420 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8295e173-f589-4e30-856e-8b326384c033 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:00.205846 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8295e173-f589-4e30-856e-8b326384c033 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:00.236007 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-da08cca3-bc83-41eb-b091-fcda1676f0bb tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:00.243616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-da08cca3-bc83-41eb-b091-fcda1676f0bb tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1310 microversion: 2.1 time: 0.089908 Sep 23 15:24:00.244482 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 238/452] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:00 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1310 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:00.347966 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-8295e173-f589-4e30-856e-8b326384c033 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:00.357200 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-8295e173-f589-4e30-856e-8b326384c033 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:00.358629 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-8295e173-f589-4e30-856e-8b326384c033 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:00.359803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-8295e173-f589-4e30-856e-8b326384c033 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1809 microversion: 2.20 time: 0.167964 Sep 23 15:24:00.360395 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 215/453] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:24:00 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:24:01.267539 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-bc85bd06-d66c-4e81-8426-6d3f9380d655 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:01.268190 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-bc85bd06-d66c-4e81-8426-6d3f9380d655 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:01.275027 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bc85bd06-d66c-4e81-8426-6d3f9380d655 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:01.275513 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bc85bd06-d66c-4e81-8426-6d3f9380d655 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:01.276513 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bc85bd06-d66c-4e81-8426-6d3f9380d655 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:01.277199 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bc85bd06-d66c-4e81-8426-6d3f9380d655 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:01.277653 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bc85bd06-d66c-4e81-8426-6d3f9380d655 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:01.278082 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bc85bd06-d66c-4e81-8426-6d3f9380d655 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:01.341222 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-bc85bd06-d66c-4e81-8426-6d3f9380d655 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:01.349110 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-bc85bd06-d66c-4e81-8426-6d3f9380d655 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1310 microversion: 2.1 time: 0.085481 Sep 23 15:24:01.349769 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 239/454] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:01 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:01.386138 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-7e37084d-fd49-45d8-a033-aa95161cc7d6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:01.386788 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-7e37084d-fd49-45d8-a033-aa95161cc7d6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:01.393401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7e37084d-fd49-45d8-a033-aa95161cc7d6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:01.393883 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7e37084d-fd49-45d8-a033-aa95161cc7d6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:01.394321 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7e37084d-fd49-45d8-a033-aa95161cc7d6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:01.395015 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7e37084d-fd49-45d8-a033-aa95161cc7d6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:01.395542 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7e37084d-fd49-45d8-a033-aa95161cc7d6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:01.396019 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7e37084d-fd49-45d8-a033-aa95161cc7d6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:01.528603 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-7e37084d-fd49-45d8-a033-aa95161cc7d6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:01.537355 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-7e37084d-fd49-45d8-a033-aa95161cc7d6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:01.538990 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-7e37084d-fd49-45d8-a033-aa95161cc7d6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:01.540187 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-7e37084d-fd49-45d8-a033-aa95161cc7d6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1809 microversion: 2.20 time: 0.158454 Sep 23 15:24:01.540749 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 216/455] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:24:01 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:24:02.374278 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-97a1759f-d680-416a-a643-4276690887e9 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:02.374908 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-97a1759f-d680-416a-a643-4276690887e9 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:02.381763 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-97a1759f-d680-416a-a643-4276690887e9 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:02.382248 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-97a1759f-d680-416a-a643-4276690887e9 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:02.382688 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-97a1759f-d680-416a-a643-4276690887e9 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:02.383380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-97a1759f-d680-416a-a643-4276690887e9 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:02.383842 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-97a1759f-d680-416a-a643-4276690887e9 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:02.384545 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-97a1759f-d680-416a-a643-4276690887e9 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:02.431076 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell0:SELECT=6 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:02.447373 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-97a1759f-d680-416a-a643-4276690887e9 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:02.455642 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-97a1759f-d680-416a-a643-4276690887e9 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1310 microversion: 2.1 time: 0.086414 Sep 23 15:24:02.456243 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 240/456] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:02 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1310 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:02.566749 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-ba418605-a353-41c7-b0cd-2dd0d94eda7c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:02.567289 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-ba418605-a353-41c7-b0cd-2dd0d94eda7c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:02.569147 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell0:SELECT=2 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:02.574595 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ba418605-a353-41c7-b0cd-2dd0d94eda7c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:02.575103 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ba418605-a353-41c7-b0cd-2dd0d94eda7c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:02.575542 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ba418605-a353-41c7-b0cd-2dd0d94eda7c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:02.576256 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ba418605-a353-41c7-b0cd-2dd0d94eda7c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:02.576715 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ba418605-a353-41c7-b0cd-2dd0d94eda7c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:02.577141 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ba418605-a353-41c7-b0cd-2dd0d94eda7c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:02.707543 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-ba418605-a353-41c7-b0cd-2dd0d94eda7c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:02.716888 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-ba418605-a353-41c7-b0cd-2dd0d94eda7c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:02.718368 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-ba418605-a353-41c7-b0cd-2dd0d94eda7c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:02.719540 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-ba418605-a353-41c7-b0cd-2dd0d94eda7c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1796 microversion: 2.20 time: 0.156797 Sep 23 15:24:02.720126 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 217/457] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:24:02 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1796 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:24:03.109213 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-452b3316-f6d0-4ca5-a566-55ca2b0556ad tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:03.111528 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-452b3316-f6d0-4ca5-a566-55ca2b0556ad tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:03.118035 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-452b3316-f6d0-4ca5-a566-55ca2b0556ad tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:03.118516 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-452b3316-f6d0-4ca5-a566-55ca2b0556ad tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:03.118945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-452b3316-f6d0-4ca5-a566-55ca2b0556ad tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:03.119628 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-452b3316-f6d0-4ca5-a566-55ca2b0556ad tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:03.120174 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-452b3316-f6d0-4ca5-a566-55ca2b0556ad tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:03.121596 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-452b3316-f6d0-4ca5-a566-55ca2b0556ad tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:03.146738 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.objects.instance [None req-452b3316-f6d0-4ca5-a566-55ca2b0556ad tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lazy-loading 'flavor' on Instance uuid 7d2de5a1-7ae9-4010-a7fc-5d2f45212418 {{(pid=121450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:24:03.479029 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-7bd23b7b-8301-4a95-8c89-d596db9d3bee tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:03.481007 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-7bd23b7b-8301-4a95-8c89-d596db9d3bee tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:03.488988 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7bd23b7b-8301-4a95-8c89-d596db9d3bee tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:03.489482 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7bd23b7b-8301-4a95-8c89-d596db9d3bee tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:03.489970 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7bd23b7b-8301-4a95-8c89-d596db9d3bee tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:03.490755 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7bd23b7b-8301-4a95-8c89-d596db9d3bee tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:03.491258 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7bd23b7b-8301-4a95-8c89-d596db9d3bee tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:03.491690 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7bd23b7b-8301-4a95-8c89-d596db9d3bee tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:03.560728 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell0:SELECT=8 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:03.564602 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-7bd23b7b-8301-4a95-8c89-d596db9d3bee tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:03.574857 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-7bd23b7b-8301-4a95-8c89-d596db9d3bee tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1328 microversion: 2.1 time: 0.099925 Sep 23 15:24:03.592116 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 218/458] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:03 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1328 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:03.803508 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-452b3316-f6d0-4ca5-a566-55ca2b0556ad tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "POST /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/action" status: 200 len: 32 microversion: 2.1 time: 0.698874 Sep 23 15:24:03.804139 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 241/459] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Sep 23 15:24:03 2022] POST /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/action => generated 32 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 15:24:03.814263 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-2a0d351a-f056-4ea2-ac61-01a73bf2f237 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:03.815163 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-2a0d351a-f056-4ea2-ac61-01a73bf2f237 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:03.822238 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2a0d351a-f056-4ea2-ac61-01a73bf2f237 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:03.822731 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2a0d351a-f056-4ea2-ac61-01a73bf2f237 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:03.823780 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2a0d351a-f056-4ea2-ac61-01a73bf2f237 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:03.824844 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2a0d351a-f056-4ea2-ac61-01a73bf2f237 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:03.825312 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2a0d351a-f056-4ea2-ac61-01a73bf2f237 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:03.825745 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2a0d351a-f056-4ea2-ac61-01a73bf2f237 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:03.972910 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-2a0d351a-f056-4ea2-ac61-01a73bf2f237 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:03.981632 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-2a0d351a-f056-4ea2-ac61-01a73bf2f237 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1737 microversion: 2.1 time: 0.171189 Sep 23 15:24:03.982117 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 219/460] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:03 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:04.083784 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-37818f05-a89f-48cf-bf99-1818345ee46e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:04.094640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-37818f05-a89f-48cf-bf99-1818345ee46e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:04.095157 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-37818f05-a89f-48cf-bf99-1818345ee46e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:04.095582 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-37818f05-a89f-48cf-bf99-1818345ee46e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:04.133259 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-37818f05-a89f-48cf-bf99-1818345ee46e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Going to try to stop instance {{(pid=121450) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 15:24:04.354765 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:04.476223 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-37818f05-a89f-48cf-bf99-1818345ee46e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "POST /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f/action" status: 202 len: 0 microversion: 2.1 time: 0.396674 Sep 23 15:24:04.476842 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 242/461] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Sep 23 15:24:04 2022] POST /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:24:04.485653 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-576a08f6-bbf4-4195-9c90-5147e6801439 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:04.486283 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-576a08f6-bbf4-4195-9c90-5147e6801439 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:04.493411 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-576a08f6-bbf4-4195-9c90-5147e6801439 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:04.494164 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-576a08f6-bbf4-4195-9c90-5147e6801439 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:04.494769 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-576a08f6-bbf4-4195-9c90-5147e6801439 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:04.496370 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-576a08f6-bbf4-4195-9c90-5147e6801439 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:04.496997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-576a08f6-bbf4-4195-9c90-5147e6801439 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:04.497753 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-576a08f6-bbf4-4195-9c90-5147e6801439 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:04.601951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-9c602663-aa13-44be-84df-8f63517749ff tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:04.603074 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-9c602663-aa13-44be-84df-8f63517749ff tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:04.619538 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9c602663-aa13-44be-84df-8f63517749ff tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:04.621378 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9c602663-aa13-44be-84df-8f63517749ff tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:04.622150 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9c602663-aa13-44be-84df-8f63517749ff tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:04.625281 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9c602663-aa13-44be-84df-8f63517749ff tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:04.627376 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9c602663-aa13-44be-84df-8f63517749ff tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:04.628680 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9c602663-aa13-44be-84df-8f63517749ff tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:04.774221 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-576a08f6-bbf4-4195-9c90-5147e6801439 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:04.784911 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-576a08f6-bbf4-4195-9c90-5147e6801439 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1676 microversion: 2.1 time: 0.303227 Sep 23 15:24:04.788868 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 220/462] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:04 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1676 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:04.982893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-9c602663-aa13-44be-84df-8f63517749ff tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:04.994515 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-9c602663-aa13-44be-84df-8f63517749ff tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1358 microversion: 2.1 time: 0.397619 Sep 23 15:24:04.995445 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 243/463] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:04 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1358 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:05.014376 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-bd691a3d-d28f-42c3-9c34-8e1ef6dabe6d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:05.015748 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-bd691a3d-d28f-42c3-9c34-8e1ef6dabe6d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:05.030418 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bd691a3d-d28f-42c3-9c34-8e1ef6dabe6d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:05.031003 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bd691a3d-d28f-42c3-9c34-8e1ef6dabe6d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:05.038088 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bd691a3d-d28f-42c3-9c34-8e1ef6dabe6d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:05.038088 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bd691a3d-d28f-42c3-9c34-8e1ef6dabe6d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:05.038088 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bd691a3d-d28f-42c3-9c34-8e1ef6dabe6d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:05.038088 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bd691a3d-d28f-42c3-9c34-8e1ef6dabe6d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:05.235172 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-bd691a3d-d28f-42c3-9c34-8e1ef6dabe6d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:05.245781 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-bd691a3d-d28f-42c3-9c34-8e1ef6dabe6d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1737 microversion: 2.1 time: 0.238611 Sep 23 15:24:05.247528 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 221/464] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:05 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1737 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:05.632174 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-51fa7491-c2bd-4bbe-be53-91dd50dcbb42 req-619b56f7-a003-45fd-8ff8-fcf8ea46b79d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14c2bdac-30a5-4a8a-ad91-191c529f77df", "tag": "f8bb92b2-35e5-484a-adc2-f6309c059f45"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:05.646581 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-51fa7491-c2bd-4bbe-be53-91dd50dcbb42 req-619b56f7-a003-45fd-8ff8-fcf8ea46b79d service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:05.647950 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-51fa7491-c2bd-4bbe-be53-91dd50dcbb42 req-619b56f7-a003-45fd-8ff8-fcf8ea46b79d service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:05.648634 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-51fa7491-c2bd-4bbe-be53-91dd50dcbb42 req-619b56f7-a003-45fd-8ff8-fcf8ea46b79d service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:05.664568 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-51fa7491-c2bd-4bbe-be53-91dd50dcbb42 req-619b56f7-a003-45fd-8ff8-fcf8ea46b79d service nova] Creating event network-changed:f8bb92b2-35e5-484a-adc2-f6309c059f45 for instance 14c2bdac-30a5-4a8a-ad91-191c529f77df on hv-cinder-85530 Sep 23 15:24:05.670822 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-51fa7491-c2bd-4bbe-be53-91dd50dcbb42 req-619b56f7-a003-45fd-8ff8-fcf8ea46b79d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043814 Sep 23 15:24:05.672751 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 244/465] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:24:05.813803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-162f57c2-f17e-47b6-9b44-c0b58cf1fff5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:05.814407 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-162f57c2-f17e-47b6-9b44-c0b58cf1fff5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:05.820869 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-162f57c2-f17e-47b6-9b44-c0b58cf1fff5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:05.821349 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-162f57c2-f17e-47b6-9b44-c0b58cf1fff5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:05.821785 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-162f57c2-f17e-47b6-9b44-c0b58cf1fff5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:05.822504 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-162f57c2-f17e-47b6-9b44-c0b58cf1fff5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:05.822959 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-162f57c2-f17e-47b6-9b44-c0b58cf1fff5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:05.824069 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-162f57c2-f17e-47b6-9b44-c0b58cf1fff5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:05.966667 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-162f57c2-f17e-47b6-9b44-c0b58cf1fff5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:05.985061 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-162f57c2-f17e-47b6-9b44-c0b58cf1fff5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1676 microversion: 2.1 time: 0.175147 Sep 23 15:24:05.986017 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 222/466] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:05 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:06.021941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-62049371-452b-4588-81ea-7f8b33572796 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:06.022674 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-62049371-452b-4588-81ea-7f8b33572796 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:06.030747 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-62049371-452b-4588-81ea-7f8b33572796 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:06.033596 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-62049371-452b-4588-81ea-7f8b33572796 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:06.033596 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-62049371-452b-4588-81ea-7f8b33572796 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:06.033596 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-62049371-452b-4588-81ea-7f8b33572796 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:06.033596 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-62049371-452b-4588-81ea-7f8b33572796 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:06.034081 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-62049371-452b-4588-81ea-7f8b33572796 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:06.044190 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-f62411d6-4361-41d0-9d7b-49e7d92593e9 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:06.044843 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-f62411d6-4361-41d0-9d7b-49e7d92593e9 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:06.051290 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f62411d6-4361-41d0-9d7b-49e7d92593e9 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:06.051894 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f62411d6-4361-41d0-9d7b-49e7d92593e9 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:06.052625 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f62411d6-4361-41d0-9d7b-49e7d92593e9 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:06.053399 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f62411d6-4361-41d0-9d7b-49e7d92593e9 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:06.053941 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f62411d6-4361-41d0-9d7b-49e7d92593e9 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:06.054430 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f62411d6-4361-41d0-9d7b-49e7d92593e9 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:06.175309 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-62049371-452b-4588-81ea-7f8b33572796 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:06.186100 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-62049371-452b-4588-81ea-7f8b33572796 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1358 microversion: 2.1 time: 0.168147 Sep 23 15:24:06.201952 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 245/467] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:06 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:06.202801 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.objects.instance [None req-f62411d6-4361-41d0-9d7b-49e7d92593e9 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lazy-loading 'services' on Instance uuid 485ab2cf-cd2f-42e5-a625-bda9af6b99b5 {{(pid=121448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:24:06.270715 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-298ebd4c-8d84-432b-8410-4be53bc874c0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:06.271332 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-298ebd4c-8d84-432b-8410-4be53bc874c0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:06.280356 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-298ebd4c-8d84-432b-8410-4be53bc874c0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:06.280848 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-298ebd4c-8d84-432b-8410-4be53bc874c0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:06.281288 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-298ebd4c-8d84-432b-8410-4be53bc874c0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:06.281988 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-298ebd4c-8d84-432b-8410-4be53bc874c0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:06.282439 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-298ebd4c-8d84-432b-8410-4be53bc874c0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:06.282859 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-298ebd4c-8d84-432b-8410-4be53bc874c0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:06.430239 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-298ebd4c-8d84-432b-8410-4be53bc874c0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:06.438976 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-298ebd4c-8d84-432b-8410-4be53bc874c0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1737 microversion: 2.1 time: 0.172116 Sep 23 15:24:06.439742 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 246/468] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:06 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:06.456012 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-f62411d6-4361-41d0-9d7b-49e7d92593e9 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "DELETE /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5/os-volume_attachments/0612a381-45ad-4844-aa42-91db13083322" status: 202 len: 0 microversion: 2.1 time: 0.416815 Sep 23 15:24:06.456620 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 223/469] 10.222.0.55 () {58 vars in 1416 bytes} [Fri Sep 23 15:24:06 2022] DELETE /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5/os-volume_attachments/0612a381-45ad-4844-aa42-91db13083322 => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 15:24:07.010011 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-956dd700-e311-4b69-830b-6e4699128412 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:07.011183 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-956dd700-e311-4b69-830b-6e4699128412 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:07.017995 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-956dd700-e311-4b69-830b-6e4699128412 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:07.018505 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-956dd700-e311-4b69-830b-6e4699128412 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:07.018940 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-956dd700-e311-4b69-830b-6e4699128412 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:07.019634 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-956dd700-e311-4b69-830b-6e4699128412 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:07.020105 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-956dd700-e311-4b69-830b-6e4699128412 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:07.020523 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-956dd700-e311-4b69-830b-6e4699128412 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:07.172063 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-956dd700-e311-4b69-830b-6e4699128412 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:07.180249 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-956dd700-e311-4b69-830b-6e4699128412 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1676 microversion: 2.1 time: 0.173981 Sep 23 15:24:07.181036 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 247/470] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:07 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:07.210811 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-5a52b481-0802-43df-824d-979e019ee2e8 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:07.211515 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-5a52b481-0802-43df-824d-979e019ee2e8 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:07.217903 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5a52b481-0802-43df-824d-979e019ee2e8 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:07.218401 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5a52b481-0802-43df-824d-979e019ee2e8 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:07.218840 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5a52b481-0802-43df-824d-979e019ee2e8 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:07.219562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5a52b481-0802-43df-824d-979e019ee2e8 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:07.220037 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5a52b481-0802-43df-824d-979e019ee2e8 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:07.220472 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5a52b481-0802-43df-824d-979e019ee2e8 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:07.358368 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-5a52b481-0802-43df-824d-979e019ee2e8 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:07.366299 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-5a52b481-0802-43df-824d-979e019ee2e8 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1358 microversion: 2.1 time: 0.160161 Sep 23 15:24:07.366882 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 224/471] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:07 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:07.462741 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-f2846055-8914-4c44-9731-b420562d0d93 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:07.463674 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-f2846055-8914-4c44-9731-b420562d0d93 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:07.472020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f2846055-8914-4c44-9731-b420562d0d93 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:07.472527 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f2846055-8914-4c44-9731-b420562d0d93 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:07.472970 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f2846055-8914-4c44-9731-b420562d0d93 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:07.473675 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f2846055-8914-4c44-9731-b420562d0d93 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:07.474275 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f2846055-8914-4c44-9731-b420562d0d93 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:07.474702 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f2846055-8914-4c44-9731-b420562d0d93 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:07.618177 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-f2846055-8914-4c44-9731-b420562d0d93 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:07.627228 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-f2846055-8914-4c44-9731-b420562d0d93 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1737 microversion: 2.1 time: 0.168641 Sep 23 15:24:07.627815 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 248/472] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:07 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:08.205068 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-cda0e2b8-d174-4665-98d2-ecc4fb207915 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:08.205677 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-cda0e2b8-d174-4665-98d2-ecc4fb207915 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:08.212439 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-cda0e2b8-d174-4665-98d2-ecc4fb207915 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:08.213062 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-cda0e2b8-d174-4665-98d2-ecc4fb207915 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:08.213342 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-cda0e2b8-d174-4665-98d2-ecc4fb207915 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:08.214681 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-cda0e2b8-d174-4665-98d2-ecc4fb207915 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:08.215138 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-cda0e2b8-d174-4665-98d2-ecc4fb207915 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:08.215566 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-cda0e2b8-d174-4665-98d2-ecc4fb207915 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:08.356374 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-cda0e2b8-d174-4665-98d2-ecc4fb207915 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:08.364850 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-cda0e2b8-d174-4665-98d2-ecc4fb207915 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1676 microversion: 2.1 time: 0.163949 Sep 23 15:24:08.365436 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 225/473] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:08 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:08.391925 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-c01873c8-94fd-4647-878d-8a5558f3d456 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:08.392570 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-c01873c8-94fd-4647-878d-8a5558f3d456 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:08.399581 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c01873c8-94fd-4647-878d-8a5558f3d456 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:08.400095 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c01873c8-94fd-4647-878d-8a5558f3d456 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:08.400577 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c01873c8-94fd-4647-878d-8a5558f3d456 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:08.401601 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c01873c8-94fd-4647-878d-8a5558f3d456 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:08.402126 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c01873c8-94fd-4647-878d-8a5558f3d456 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:08.402665 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c01873c8-94fd-4647-878d-8a5558f3d456 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:08.549227 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-c01873c8-94fd-4647-878d-8a5558f3d456 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:08.557038 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-c01873c8-94fd-4647-878d-8a5558f3d456 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1358 microversion: 2.1 time: 0.169122 Sep 23 15:24:08.558311 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 249/474] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:08 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:08.650837 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-5ed80c84-8b2d-4a42-9f20-437b21e5c34e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:08.651902 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-5ed80c84-8b2d-4a42-9f20-437b21e5c34e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:08.658557 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5ed80c84-8b2d-4a42-9f20-437b21e5c34e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:08.659043 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5ed80c84-8b2d-4a42-9f20-437b21e5c34e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:08.659477 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5ed80c84-8b2d-4a42-9f20-437b21e5c34e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:08.660205 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5ed80c84-8b2d-4a42-9f20-437b21e5c34e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:08.660667 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5ed80c84-8b2d-4a42-9f20-437b21e5c34e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:08.661090 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5ed80c84-8b2d-4a42-9f20-437b21e5c34e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:08.665808 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:08.809186 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-5ed80c84-8b2d-4a42-9f20-437b21e5c34e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:08.821045 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-5ed80c84-8b2d-4a42-9f20-437b21e5c34e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1737 microversion: 2.1 time: 0.174119 Sep 23 15:24:08.821811 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 226/475] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:08 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:09.390360 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-0f042fce-2e5c-4831-ab40-675a19685c74 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:09.390909 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-0f042fce-2e5c-4831-ab40-675a19685c74 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:09.397605 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0f042fce-2e5c-4831-ab40-675a19685c74 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:09.398290 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0f042fce-2e5c-4831-ab40-675a19685c74 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:09.398509 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0f042fce-2e5c-4831-ab40-675a19685c74 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:09.399234 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0f042fce-2e5c-4831-ab40-675a19685c74 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:09.399685 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0f042fce-2e5c-4831-ab40-675a19685c74 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:09.400136 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0f042fce-2e5c-4831-ab40-675a19685c74 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:09.536111 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-0f042fce-2e5c-4831-ab40-675a19685c74 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:09.544847 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-0f042fce-2e5c-4831-ab40-675a19685c74 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1676 microversion: 2.1 time: 0.158417 Sep 23 15:24:09.545694 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 250/476] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:09 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:09.580664 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-b284a0b3-0a18-4aaf-bf12-aa8c3fb89eb9 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:09.581611 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-b284a0b3-0a18-4aaf-bf12-aa8c3fb89eb9 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:09.588173 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b284a0b3-0a18-4aaf-bf12-aa8c3fb89eb9 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:09.589202 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b284a0b3-0a18-4aaf-bf12-aa8c3fb89eb9 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:09.589661 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b284a0b3-0a18-4aaf-bf12-aa8c3fb89eb9 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:09.590377 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b284a0b3-0a18-4aaf-bf12-aa8c3fb89eb9 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:09.590836 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b284a0b3-0a18-4aaf-bf12-aa8c3fb89eb9 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:09.591466 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b284a0b3-0a18-4aaf-bf12-aa8c3fb89eb9 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:09.726315 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b284a0b3-0a18-4aaf-bf12-aa8c3fb89eb9 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:09.734747 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-b284a0b3-0a18-4aaf-bf12-aa8c3fb89eb9 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1358 microversion: 2.1 time: 0.157968 Sep 23 15:24:09.735315 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 227/477] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:09 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:09.846827 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-4cedf626-cc0a-43ef-8898-99acfea36ca5 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:09.847758 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-4cedf626-cc0a-43ef-8898-99acfea36ca5 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:09.857041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4cedf626-cc0a-43ef-8898-99acfea36ca5 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:09.857794 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4cedf626-cc0a-43ef-8898-99acfea36ca5 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:09.858366 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4cedf626-cc0a-43ef-8898-99acfea36ca5 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:09.859190 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4cedf626-cc0a-43ef-8898-99acfea36ca5 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:09.859732 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4cedf626-cc0a-43ef-8898-99acfea36ca5 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:09.860274 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4cedf626-cc0a-43ef-8898-99acfea36ca5 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:10.010239 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-4cedf626-cc0a-43ef-8898-99acfea36ca5 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:10.020173 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-4cedf626-cc0a-43ef-8898-99acfea36ca5 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1737 microversion: 2.1 time: 0.178183 Sep 23 15:24:10.021248 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 251/478] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:09 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:10.569222 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-67bcbecd-20a4-47a0-9486-99b2752ef73f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:10.570155 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-67bcbecd-20a4-47a0-9486-99b2752ef73f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:10.576691 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-67bcbecd-20a4-47a0-9486-99b2752ef73f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:10.577173 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-67bcbecd-20a4-47a0-9486-99b2752ef73f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:10.577608 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-67bcbecd-20a4-47a0-9486-99b2752ef73f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:10.578333 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-67bcbecd-20a4-47a0-9486-99b2752ef73f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:10.578787 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-67bcbecd-20a4-47a0-9486-99b2752ef73f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:10.579210 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-67bcbecd-20a4-47a0-9486-99b2752ef73f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:10.721573 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-67bcbecd-20a4-47a0-9486-99b2752ef73f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:10.729966 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-67bcbecd-20a4-47a0-9486-99b2752ef73f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1676 microversion: 2.1 time: 0.164500 Sep 23 15:24:10.730720 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 228/479] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:10 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:10.758352 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-07999332-ef70-411c-bf2e-bf854402584c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:10.759136 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-07999332-ef70-411c-bf2e-bf854402584c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:10.766123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-07999332-ef70-411c-bf2e-bf854402584c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:10.766615 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-07999332-ef70-411c-bf2e-bf854402584c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:10.767055 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-07999332-ef70-411c-bf2e-bf854402584c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:10.767759 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-07999332-ef70-411c-bf2e-bf854402584c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:10.768243 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-07999332-ef70-411c-bf2e-bf854402584c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:10.768667 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-07999332-ef70-411c-bf2e-bf854402584c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:10.909297 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-07999332-ef70-411c-bf2e-bf854402584c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:10.918518 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-07999332-ef70-411c-bf2e-bf854402584c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1358 microversion: 2.1 time: 0.163994 Sep 23 15:24:10.936440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 252/480] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:10 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:11.053908 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a15597dc-f604-4d1b-9ba4-3f5d7b862880 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:11.054807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-a15597dc-f604-4d1b-9ba4-3f5d7b862880 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:11.065676 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a15597dc-f604-4d1b-9ba4-3f5d7b862880 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:11.066173 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a15597dc-f604-4d1b-9ba4-3f5d7b862880 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:11.066611 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a15597dc-f604-4d1b-9ba4-3f5d7b862880 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:11.067452 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a15597dc-f604-4d1b-9ba4-3f5d7b862880 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:11.067924 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a15597dc-f604-4d1b-9ba4-3f5d7b862880 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:11.068379 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a15597dc-f604-4d1b-9ba4-3f5d7b862880 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:11.273416 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a15597dc-f604-4d1b-9ba4-3f5d7b862880 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:11.282585 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-a15597dc-f604-4d1b-9ba4-3f5d7b862880 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1737 microversion: 2.1 time: 0.232407 Sep 23 15:24:11.283332 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 229/481] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:11 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1737 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:11.754400 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-1da68719-0989-4553-ade2-072288172521 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:11.755008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-1da68719-0989-4553-ade2-072288172521 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:11.761259 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1da68719-0989-4553-ade2-072288172521 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:11.761855 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1da68719-0989-4553-ade2-072288172521 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:11.762172 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1da68719-0989-4553-ade2-072288172521 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:11.762865 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1da68719-0989-4553-ade2-072288172521 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:11.763320 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1da68719-0989-4553-ade2-072288172521 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:11.763743 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1da68719-0989-4553-ade2-072288172521 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:11.938386 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-1da68719-0989-4553-ade2-072288172521 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:11.943747 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-0b450407-ceac-48f5-b6cf-47284517a25c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:11.944968 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-0b450407-ceac-48f5-b6cf-47284517a25c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:11.947107 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-1da68719-0989-4553-ade2-072288172521 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1676 microversion: 2.1 time: 0.196739 Sep 23 15:24:11.947751 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 253/482] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:11 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1676 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:11.950524 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:11.954206 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0b450407-ceac-48f5-b6cf-47284517a25c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:11.954696 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0b450407-ceac-48f5-b6cf-47284517a25c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:11.959564 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0b450407-ceac-48f5-b6cf-47284517a25c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:11.960448 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0b450407-ceac-48f5-b6cf-47284517a25c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:11.961041 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0b450407-ceac-48f5-b6cf-47284517a25c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:11.964664 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0b450407-ceac-48f5-b6cf-47284517a25c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:12.309095 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-4bf98ece-7a36-4d45-9e92-09ee7fe6343c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:12.310021 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-4bf98ece-7a36-4d45-9e92-09ee7fe6343c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:12.316629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4bf98ece-7a36-4d45-9e92-09ee7fe6343c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:12.317128 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4bf98ece-7a36-4d45-9e92-09ee7fe6343c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:12.317568 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4bf98ece-7a36-4d45-9e92-09ee7fe6343c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:12.318294 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4bf98ece-7a36-4d45-9e92-09ee7fe6343c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:12.324843 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4bf98ece-7a36-4d45-9e92-09ee7fe6343c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:12.325308 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4bf98ece-7a36-4d45-9e92-09ee7fe6343c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:12.358317 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-0b450407-ceac-48f5-b6cf-47284517a25c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:12.366529 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-0b450407-ceac-48f5-b6cf-47284517a25c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1358 microversion: 2.1 time: 0.426482 Sep 23 15:24:12.368013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 230/483] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:11 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1358 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:12.470398 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-4bf98ece-7a36-4d45-9e92-09ee7fe6343c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:12.478788 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-4bf98ece-7a36-4d45-9e92-09ee7fe6343c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1737 microversion: 2.1 time: 0.175763 Sep 23 15:24:12.480241 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 254/484] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:12 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:12.972724 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6c2b01ee-5d4d-4729-a993-dc5b57bd1339 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:12.973332 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-6c2b01ee-5d4d-4729-a993-dc5b57bd1339 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:12.979812 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6c2b01ee-5d4d-4729-a993-dc5b57bd1339 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:12.984639 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6c2b01ee-5d4d-4729-a993-dc5b57bd1339 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:12.984639 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6c2b01ee-5d4d-4729-a993-dc5b57bd1339 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:12.984639 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6c2b01ee-5d4d-4729-a993-dc5b57bd1339 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:12.984639 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6c2b01ee-5d4d-4729-a993-dc5b57bd1339 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:12.985047 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6c2b01ee-5d4d-4729-a993-dc5b57bd1339 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:13.137206 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6c2b01ee-5d4d-4729-a993-dc5b57bd1339 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:13.146842 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-6c2b01ee-5d4d-4729-a993-dc5b57bd1339 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1676 microversion: 2.1 time: 0.178551 Sep 23 15:24:13.147935 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 231/485] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:12 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:13.390122 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-0d01c241-1eed-402d-a3ee-ba00ef18eff1 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:13.390727 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-0d01c241-1eed-402d-a3ee-ba00ef18eff1 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:13.397754 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0d01c241-1eed-402d-a3ee-ba00ef18eff1 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:13.398239 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0d01c241-1eed-402d-a3ee-ba00ef18eff1 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:13.398670 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0d01c241-1eed-402d-a3ee-ba00ef18eff1 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:13.399364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0d01c241-1eed-402d-a3ee-ba00ef18eff1 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:13.399814 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0d01c241-1eed-402d-a3ee-ba00ef18eff1 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:13.400256 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0d01c241-1eed-402d-a3ee-ba00ef18eff1 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:13.506460 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-bae866c4-bb30-49ac-ad74-1abc578b4ebc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:13.507155 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-bae866c4-bb30-49ac-ad74-1abc578b4ebc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:13.515744 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bae866c4-bb30-49ac-ad74-1abc578b4ebc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:13.516270 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bae866c4-bb30-49ac-ad74-1abc578b4ebc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:13.516781 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bae866c4-bb30-49ac-ad74-1abc578b4ebc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:13.517520 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bae866c4-bb30-49ac-ad74-1abc578b4ebc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:13.517983 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bae866c4-bb30-49ac-ad74-1abc578b4ebc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:13.519176 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bae866c4-bb30-49ac-ad74-1abc578b4ebc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:13.572416 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-0d01c241-1eed-402d-a3ee-ba00ef18eff1 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:13.582402 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-0d01c241-1eed-402d-a3ee-ba00ef18eff1 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1358 microversion: 2.1 time: 0.196106 Sep 23 15:24:13.600255 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 255/486] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:13 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:13.663654 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-bae866c4-bb30-49ac-ad74-1abc578b4ebc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:13.672514 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-bae866c4-bb30-49ac-ad74-1abc578b4ebc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1737 microversion: 2.1 time: 0.170680 Sep 23 15:24:13.673089 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 232/487] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:13 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:14.175832 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-f067b4d1-edf6-45ca-9dbc-07e9a568aa34 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:14.176529 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-f067b4d1-edf6-45ca-9dbc-07e9a568aa34 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:14.183594 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f067b4d1-edf6-45ca-9dbc-07e9a568aa34 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:14.184272 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f067b4d1-edf6-45ca-9dbc-07e9a568aa34 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:14.184693 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f067b4d1-edf6-45ca-9dbc-07e9a568aa34 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:14.185399 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f067b4d1-edf6-45ca-9dbc-07e9a568aa34 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:14.185862 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f067b4d1-edf6-45ca-9dbc-07e9a568aa34 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:14.186289 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f067b4d1-edf6-45ca-9dbc-07e9a568aa34 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:14.324281 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-f067b4d1-edf6-45ca-9dbc-07e9a568aa34 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:14.331885 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-f067b4d1-edf6-45ca-9dbc-07e9a568aa34 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1676 microversion: 2.1 time: 0.160079 Sep 23 15:24:14.332474 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 256/488] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:14 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:14.614099 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-1ca4bcd8-408d-40f5-9f1a-60345e1c2522 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:14.614691 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-1ca4bcd8-408d-40f5-9f1a-60345e1c2522 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:14.625497 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1ca4bcd8-408d-40f5-9f1a-60345e1c2522 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:14.630626 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1ca4bcd8-408d-40f5-9f1a-60345e1c2522 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:14.630626 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1ca4bcd8-408d-40f5-9f1a-60345e1c2522 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:14.630626 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1ca4bcd8-408d-40f5-9f1a-60345e1c2522 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:14.630626 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1ca4bcd8-408d-40f5-9f1a-60345e1c2522 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:14.631037 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1ca4bcd8-408d-40f5-9f1a-60345e1c2522 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:14.699135 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-751ce0f4-ba44-4b78-a901-a6caa6c09bbc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:14.700366 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-751ce0f4-ba44-4b78-a901-a6caa6c09bbc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:14.715888 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-751ce0f4-ba44-4b78-a901-a6caa6c09bbc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:14.716755 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-751ce0f4-ba44-4b78-a901-a6caa6c09bbc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:14.717375 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-751ce0f4-ba44-4b78-a901-a6caa6c09bbc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:14.718299 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-751ce0f4-ba44-4b78-a901-a6caa6c09bbc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:14.718962 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-751ce0f4-ba44-4b78-a901-a6caa6c09bbc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:14.719588 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-751ce0f4-ba44-4b78-a901-a6caa6c09bbc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:14.806772 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-1ca4bcd8-408d-40f5-9f1a-60345e1c2522 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:14.816920 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-1ca4bcd8-408d-40f5-9f1a-60345e1c2522 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1358 microversion: 2.1 time: 0.206501 Sep 23 15:24:14.817522 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 233/489] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:14 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:15.139571 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-751ce0f4-ba44-4b78-a901-a6caa6c09bbc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:15.148029 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-751ce0f4-ba44-4b78-a901-a6caa6c09bbc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1737 microversion: 2.1 time: 0.452931 Sep 23 15:24:15.148604 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 257/490] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:14 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1737 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:15.355485 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-e91b24bd-4436-457f-9f22-c97b4c2bcf26 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:15.356152 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-e91b24bd-4436-457f-9f22-c97b4c2bcf26 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:15.362015 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e91b24bd-4436-457f-9f22-c97b4c2bcf26 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:15.362492 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e91b24bd-4436-457f-9f22-c97b4c2bcf26 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:15.362928 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e91b24bd-4436-457f-9f22-c97b4c2bcf26 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:15.363612 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e91b24bd-4436-457f-9f22-c97b4c2bcf26 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:15.364085 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e91b24bd-4436-457f-9f22-c97b4c2bcf26 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:15.364748 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e91b24bd-4436-457f-9f22-c97b4c2bcf26 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:15.508853 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-e91b24bd-4436-457f-9f22-c97b4c2bcf26 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:15.516799 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-e91b24bd-4436-457f-9f22-c97b4c2bcf26 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1653 microversion: 2.1 time: 0.165843 Sep 23 15:24:15.517583 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 234/491] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:15 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1653 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:15.541111 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-51075b55-c97c-4959-beee-0d79aa2d13ea tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:15.548112 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-51075b55-c97c-4959-beee-0d79aa2d13ea tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:15.548989 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-51075b55-c97c-4959-beee-0d79aa2d13ea tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:15.548989 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-51075b55-c97c-4959-beee-0d79aa2d13ea tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:15.572533 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-51075b55-c97c-4959-beee-0d79aa2d13ea tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Going to try to start instance {{(pid=121450) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 23 15:24:15.806737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-51075b55-c97c-4959-beee-0d79aa2d13ea tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "POST /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f/action" status: 202 len: 0 microversion: 2.1 time: 0.269721 Sep 23 15:24:15.808425 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 258/492] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Sep 23 15:24:15 2022] POST /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:24:15.816748 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-40f6189f-f4a0-4c85-912f-34f4793111cf tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:15.817443 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-40f6189f-f4a0-4c85-912f-34f4793111cf tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:15.825312 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-40f6189f-f4a0-4c85-912f-34f4793111cf tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:15.825804 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-40f6189f-f4a0-4c85-912f-34f4793111cf tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:15.826251 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-40f6189f-f4a0-4c85-912f-34f4793111cf tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:15.826962 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-40f6189f-f4a0-4c85-912f-34f4793111cf tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:15.827424 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-40f6189f-f4a0-4c85-912f-34f4793111cf tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:15.827854 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-40f6189f-f4a0-4c85-912f-34f4793111cf tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:15.841773 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-09dd99d5-8455-407c-97c4-9f27fcb734ba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:15.842471 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-09dd99d5-8455-407c-97c4-9f27fcb734ba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:15.849638 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-09dd99d5-8455-407c-97c4-9f27fcb734ba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:15.851431 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-09dd99d5-8455-407c-97c4-9f27fcb734ba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:15.852075 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-09dd99d5-8455-407c-97c4-9f27fcb734ba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:15.853224 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-09dd99d5-8455-407c-97c4-9f27fcb734ba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:15.855718 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-09dd99d5-8455-407c-97c4-9f27fcb734ba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:15.856412 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-09dd99d5-8455-407c-97c4-9f27fcb734ba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:15.862838 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:15.986353 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-40f6189f-f4a0-4c85-912f-34f4793111cf tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:15.995115 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-40f6189f-f4a0-4c85-912f-34f4793111cf tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1662 microversion: 2.1 time: 0.181589 Sep 23 15:24:15.996022 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 235/493] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:15 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1662 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:16.174553 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-430a347c-a951-483b-956a-4ee7e157443a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:16.175157 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-430a347c-a951-483b-956a-4ee7e157443a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:16.183089 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-430a347c-a951-483b-956a-4ee7e157443a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:16.183614 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-430a347c-a951-483b-956a-4ee7e157443a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:16.184085 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-430a347c-a951-483b-956a-4ee7e157443a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:16.184795 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-430a347c-a951-483b-956a-4ee7e157443a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:16.185333 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-430a347c-a951-483b-956a-4ee7e157443a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:16.200750 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-430a347c-a951-483b-956a-4ee7e157443a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:16.211809 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-09dd99d5-8455-407c-97c4-9f27fcb734ba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:16.228747 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-09dd99d5-8455-407c-97c4-9f27fcb734ba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1358 microversion: 2.1 time: 0.391622 Sep 23 15:24:16.232486 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 259/494] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:15 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1358 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:16.345481 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-430a347c-a951-483b-956a-4ee7e157443a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:16.345481 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-430a347c-a951-483b-956a-4ee7e157443a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1737 microversion: 2.1 time: 0.173073 Sep 23 15:24:16.345481 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 236/495] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:16 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:16.363567 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-3bc643fa-b87e-4aca-bc01-c34cdc5b6a32 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:16.364081 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-3bc643fa-b87e-4aca-bc01-c34cdc5b6a32 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:16.370838 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3bc643fa-b87e-4aca-bc01-c34cdc5b6a32 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:16.371311 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3bc643fa-b87e-4aca-bc01-c34cdc5b6a32 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:16.372550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3bc643fa-b87e-4aca-bc01-c34cdc5b6a32 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:16.373425 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3bc643fa-b87e-4aca-bc01-c34cdc5b6a32 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:16.373884 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3bc643fa-b87e-4aca-bc01-c34cdc5b6a32 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:16.374303 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3bc643fa-b87e-4aca-bc01-c34cdc5b6a32 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:16.408588 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-3bc643fa-b87e-4aca-bc01-c34cdc5b6a32 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Going to try to terminate instance {{(pid=121450) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:24:16.872309 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-3bc643fa-b87e-4aca-bc01-c34cdc5b6a32 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "DELETE /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5" status: 204 len: 0 microversion: 2.1 time: 0.512466 Sep 23 15:24:16.873373 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 260/496] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Sep 23 15:24:16 2022] DELETE /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:24:16.881282 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-ba5f4c68-3c26-409e-935c-abe5837733ed tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:16.881894 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-ba5f4c68-3c26-409e-935c-abe5837733ed tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:16.888882 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ba5f4c68-3c26-409e-935c-abe5837733ed tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:16.889366 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ba5f4c68-3c26-409e-935c-abe5837733ed tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:16.889804 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ba5f4c68-3c26-409e-935c-abe5837733ed tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:16.890489 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ba5f4c68-3c26-409e-935c-abe5837733ed tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:16.890945 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ba5f4c68-3c26-409e-935c-abe5837733ed tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:16.891371 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ba5f4c68-3c26-409e-935c-abe5837733ed tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:17.019415 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-51d45c97-c080-4463-8622-547715453ed4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:17.020144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-51d45c97-c080-4463-8622-547715453ed4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:17.026586 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-51d45c97-c080-4463-8622-547715453ed4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:17.027128 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-51d45c97-c080-4463-8622-547715453ed4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:17.027577 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-51d45c97-c080-4463-8622-547715453ed4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:17.028310 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-51d45c97-c080-4463-8622-547715453ed4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:17.028573 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-ba5f4c68-3c26-409e-935c-abe5837733ed tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:17.028771 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-51d45c97-c080-4463-8622-547715453ed4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:17.029261 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-51d45c97-c080-4463-8622-547715453ed4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:17.036513 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-ba5f4c68-3c26-409e-935c-abe5837733ed tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5" status: 200 len: 1514 microversion: 2.1 time: 0.159184 Sep 23 15:24:17.037098 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 237/497] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:16 2022] GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:17.164449 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-51d45c97-c080-4463-8622-547715453ed4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:17.172408 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-51d45c97-c080-4463-8622-547715453ed4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1662 microversion: 2.1 time: 0.157172 Sep 23 15:24:17.172981 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 261/498] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:17 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1662 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:17.254844 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-acfea934-7e50-4142-a7b1-1f7a20e028b3 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:17.255443 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-acfea934-7e50-4142-a7b1-1f7a20e028b3 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:17.262120 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-acfea934-7e50-4142-a7b1-1f7a20e028b3 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:17.262612 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-acfea934-7e50-4142-a7b1-1f7a20e028b3 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:17.263026 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-acfea934-7e50-4142-a7b1-1f7a20e028b3 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:17.263758 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-acfea934-7e50-4142-a7b1-1f7a20e028b3 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:17.264241 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-acfea934-7e50-4142-a7b1-1f7a20e028b3 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:17.264663 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-acfea934-7e50-4142-a7b1-1f7a20e028b3 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:17.367245 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-e9432d22-2c8e-46ad-a099-8968b004b144 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:17.367845 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-e9432d22-2c8e-46ad-a099-8968b004b144 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:17.374457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e9432d22-2c8e-46ad-a099-8968b004b144 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:17.374869 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e9432d22-2c8e-46ad-a099-8968b004b144 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:17.375305 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e9432d22-2c8e-46ad-a099-8968b004b144 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:17.376006 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e9432d22-2c8e-46ad-a099-8968b004b144 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:17.376457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e9432d22-2c8e-46ad-a099-8968b004b144 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:17.376875 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e9432d22-2c8e-46ad-a099-8968b004b144 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:17.396151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-acfea934-7e50-4142-a7b1-1f7a20e028b3 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:17.404378 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-acfea934-7e50-4142-a7b1-1f7a20e028b3 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1358 microversion: 2.1 time: 0.153531 Sep 23 15:24:17.404954 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 238/499] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:17 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:17.507784 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-e9432d22-2c8e-46ad-a099-8968b004b144 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:17.516333 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-e9432d22-2c8e-46ad-a099-8968b004b144 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1737 microversion: 2.1 time: 0.152858 Sep 23 15:24:17.516907 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 262/500] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:17 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:18.061637 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-12addf11-b604-4a82-bcb6-4419f67e13a0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:18.062231 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-12addf11-b604-4a82-bcb6-4419f67e13a0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:18.068784 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-12addf11-b604-4a82-bcb6-4419f67e13a0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:18.075937 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-12addf11-b604-4a82-bcb6-4419f67e13a0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:18.075937 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-12addf11-b604-4a82-bcb6-4419f67e13a0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:18.075937 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-12addf11-b604-4a82-bcb6-4419f67e13a0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:18.075937 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-12addf11-b604-4a82-bcb6-4419f67e13a0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:18.077067 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-12addf11-b604-4a82-bcb6-4419f67e13a0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:18.196654 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-5590dff1-e7e2-48e4-9ef7-f69e4449569c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:18.197260 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-5590dff1-e7e2-48e4-9ef7-f69e4449569c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:18.205064 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5590dff1-e7e2-48e4-9ef7-f69e4449569c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:18.205404 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5590dff1-e7e2-48e4-9ef7-f69e4449569c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:18.205892 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5590dff1-e7e2-48e4-9ef7-f69e4449569c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:18.206588 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5590dff1-e7e2-48e4-9ef7-f69e4449569c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:18.207040 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5590dff1-e7e2-48e4-9ef7-f69e4449569c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:18.207464 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5590dff1-e7e2-48e4-9ef7-f69e4449569c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:18.207885 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-12addf11-b604-4a82-bcb6-4419f67e13a0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:18.216766 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-12addf11-b604-4a82-bcb6-4419f67e13a0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5" status: 200 len: 1514 microversion: 2.1 time: 0.159655 Sep 23 15:24:18.217339 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 239/501] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:18 2022] GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:18.341059 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-5590dff1-e7e2-48e4-9ef7-f69e4449569c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:18.348855 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-5590dff1-e7e2-48e4-9ef7-f69e4449569c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1662 microversion: 2.1 time: 0.156133 Sep 23 15:24:18.349460 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 263/502] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:18 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:18.428434 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-8805fd1a-f39d-4650-9802-391d8137ca57 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:18.429121 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-8805fd1a-f39d-4650-9802-391d8137ca57 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:18.436324 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8805fd1a-f39d-4650-9802-391d8137ca57 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:18.436847 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8805fd1a-f39d-4650-9802-391d8137ca57 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:18.437283 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8805fd1a-f39d-4650-9802-391d8137ca57 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:18.437983 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8805fd1a-f39d-4650-9802-391d8137ca57 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:18.438438 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8805fd1a-f39d-4650-9802-391d8137ca57 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:18.438855 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8805fd1a-f39d-4650-9802-391d8137ca57 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:18.540099 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-d391f3b6-9874-47bd-b049-a50653fbb7ab tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:18.541161 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-d391f3b6-9874-47bd-b049-a50653fbb7ab tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:18.547806 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d391f3b6-9874-47bd-b049-a50653fbb7ab tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:18.548485 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d391f3b6-9874-47bd-b049-a50653fbb7ab tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:18.548925 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d391f3b6-9874-47bd-b049-a50653fbb7ab tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:18.549619 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d391f3b6-9874-47bd-b049-a50653fbb7ab tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:18.550062 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d391f3b6-9874-47bd-b049-a50653fbb7ab tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:18.550478 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d391f3b6-9874-47bd-b049-a50653fbb7ab tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:18.576701 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-8805fd1a-f39d-4650-9802-391d8137ca57 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:18.585869 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-8805fd1a-f39d-4650-9802-391d8137ca57 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1358 microversion: 2.1 time: 0.161365 Sep 23 15:24:18.586642 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 240/503] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:18 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:18.702749 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-d391f3b6-9874-47bd-b049-a50653fbb7ab tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:18.720516 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-d391f3b6-9874-47bd-b049-a50653fbb7ab tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1737 microversion: 2.1 time: 0.184448 Sep 23 15:24:18.721189 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 264/504] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:18 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:19.239772 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-bf18f9be-8d58-466b-8029-28f349f6bf7e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:19.240391 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-bf18f9be-8d58-466b-8029-28f349f6bf7e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:19.249988 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf18f9be-8d58-466b-8029-28f349f6bf7e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:19.250660 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf18f9be-8d58-466b-8029-28f349f6bf7e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:19.251226 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf18f9be-8d58-466b-8029-28f349f6bf7e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:19.252131 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf18f9be-8d58-466b-8029-28f349f6bf7e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:19.252985 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf18f9be-8d58-466b-8029-28f349f6bf7e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:19.253508 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf18f9be-8d58-466b-8029-28f349f6bf7e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:19.372412 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-06e8fbcf-a2b7-42ba-b220-1c9cef619959 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:19.373031 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-06e8fbcf-a2b7-42ba-b220-1c9cef619959 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:19.379994 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-06e8fbcf-a2b7-42ba-b220-1c9cef619959 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:19.380517 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-06e8fbcf-a2b7-42ba-b220-1c9cef619959 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:19.380945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-06e8fbcf-a2b7-42ba-b220-1c9cef619959 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:19.381643 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-06e8fbcf-a2b7-42ba-b220-1c9cef619959 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:19.382097 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-06e8fbcf-a2b7-42ba-b220-1c9cef619959 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:19.382524 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-06e8fbcf-a2b7-42ba-b220-1c9cef619959 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:19.394679 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-bf18f9be-8d58-466b-8029-28f349f6bf7e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:19.408374 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-bf18f9be-8d58-466b-8029-28f349f6bf7e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5" status: 200 len: 1514 microversion: 2.1 time: 0.172332 Sep 23 15:24:19.408994 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 241/505] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:19 2022] GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:19.608858 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-e4aecde1-62f8-4a55-b8da-58bc4dd2a7c0 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:19.609622 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-e4aecde1-62f8-4a55-b8da-58bc4dd2a7c0 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:19.615455 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e4aecde1-62f8-4a55-b8da-58bc4dd2a7c0 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:19.615933 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e4aecde1-62f8-4a55-b8da-58bc4dd2a7c0 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:19.616395 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e4aecde1-62f8-4a55-b8da-58bc4dd2a7c0 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:19.617075 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e4aecde1-62f8-4a55-b8da-58bc4dd2a7c0 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:19.617563 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e4aecde1-62f8-4a55-b8da-58bc4dd2a7c0 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:19.617986 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e4aecde1-62f8-4a55-b8da-58bc4dd2a7c0 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:19.630108 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-06e8fbcf-a2b7-42ba-b220-1c9cef619959 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:19.640097 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-06e8fbcf-a2b7-42ba-b220-1c9cef619959 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1662 microversion: 2.1 time: 0.271656 Sep 23 15:24:19.642838 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 265/506] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:19 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1662 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:19.748528 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-17adf323-f2bc-4ba5-a324-fcafe6a336d4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:19.749429 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-17adf323-f2bc-4ba5-a324-fcafe6a336d4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:19.756193 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-17adf323-f2bc-4ba5-a324-fcafe6a336d4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:19.756659 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-17adf323-f2bc-4ba5-a324-fcafe6a336d4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:19.757207 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-17adf323-f2bc-4ba5-a324-fcafe6a336d4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:19.757984 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-17adf323-f2bc-4ba5-a324-fcafe6a336d4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:19.758568 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-17adf323-f2bc-4ba5-a324-fcafe6a336d4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:19.759033 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-17adf323-f2bc-4ba5-a324-fcafe6a336d4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:19.767937 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-e4aecde1-62f8-4a55-b8da-58bc4dd2a7c0 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:19.771549 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=100 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:19.784348 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-e4aecde1-62f8-4a55-b8da-58bc4dd2a7c0 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1358 microversion: 2.1 time: 0.172102 Sep 23 15:24:19.799870 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 242/507] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:19 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:19.979710 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-17adf323-f2bc-4ba5-a324-fcafe6a336d4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:19.988152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-17adf323-f2bc-4ba5-a324-fcafe6a336d4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1737 microversion: 2.1 time: 0.244123 Sep 23 15:24:19.991279 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 266/508] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:19 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1737 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:20.246722 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-1226b819-743f-41b0-9133-c944c4ab0b47 req-de518fd2-8eec-4c25-9316-d88e751fba0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "485ab2cf-cd2f-42e5-a625-bda9af6b99b5", "name": "network-vif-deleted", "tag": "a77f6045-1b49-44c2-897a-62ae2ea00ad4"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:20.257168 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-1226b819-743f-41b0-9133-c944c4ab0b47 req-de518fd2-8eec-4c25-9316-d88e751fba0d service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:20.257638 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-1226b819-743f-41b0-9133-c944c4ab0b47 req-de518fd2-8eec-4c25-9316-d88e751fba0d service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:20.258310 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-1226b819-743f-41b0-9133-c944c4ab0b47 req-de518fd2-8eec-4c25-9316-d88e751fba0d service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:20.270614 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-1226b819-743f-41b0-9133-c944c4ab0b47 req-de518fd2-8eec-4c25-9316-d88e751fba0d service nova] Creating event network-vif-deleted:a77f6045-1b49-44c2-897a-62ae2ea00ad4 for instance 485ab2cf-cd2f-42e5-a625-bda9af6b99b5 on hv-cinder-85530 Sep 23 15:24:20.276382 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-1226b819-743f-41b0-9133-c944c4ab0b47 req-de518fd2-8eec-4c25-9316-d88e751fba0d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033798 Sep 23 15:24:20.277602 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 243/509] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:24:20.433865 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-20d2895e-bfdf-478f-8b03-ecc9b96e8e78 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:20.434482 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-20d2895e-bfdf-478f-8b03-ecc9b96e8e78 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:20.441458 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-20d2895e-bfdf-478f-8b03-ecc9b96e8e78 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:20.441939 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-20d2895e-bfdf-478f-8b03-ecc9b96e8e78 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:20.442400 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-20d2895e-bfdf-478f-8b03-ecc9b96e8e78 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:20.443099 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-20d2895e-bfdf-478f-8b03-ecc9b96e8e78 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:20.443553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-20d2895e-bfdf-478f-8b03-ecc9b96e8e78 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:20.443997 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-20d2895e-bfdf-478f-8b03-ecc9b96e8e78 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:20.513468 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-20d2895e-bfdf-478f-8b03-ecc9b96e8e78 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:20.521313 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-20d2895e-bfdf-478f-8b03-ecc9b96e8e78 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5" status: 200 len: 1472 microversion: 2.1 time: 0.092568 Sep 23 15:24:20.521885 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 267/510] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:20 2022] GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5 => generated 1472 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:20.665828 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-4a501b44-f929-4e80-8cc5-766302ff82df tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:20.667131 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-4a501b44-f929-4e80-8cc5-766302ff82df tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:20.673326 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4a501b44-f929-4e80-8cc5-766302ff82df tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:20.673813 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4a501b44-f929-4e80-8cc5-766302ff82df tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:20.674255 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4a501b44-f929-4e80-8cc5-766302ff82df tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:20.674953 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4a501b44-f929-4e80-8cc5-766302ff82df tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:20.675413 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4a501b44-f929-4e80-8cc5-766302ff82df tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:20.675843 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4a501b44-f929-4e80-8cc5-766302ff82df tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:20.808836 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-4a501b44-f929-4e80-8cc5-766302ff82df tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:20.809143 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-6568437b-0697-4136-a76d-9afc446a6939 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:20.809751 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-6568437b-0697-4136-a76d-9afc446a6939 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:20.816123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6568437b-0697-4136-a76d-9afc446a6939 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:20.816565 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6568437b-0697-4136-a76d-9afc446a6939 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:20.816775 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-4a501b44-f929-4e80-8cc5-766302ff82df tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1666 microversion: 2.1 time: 0.155345 Sep 23 15:24:20.817031 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6568437b-0697-4136-a76d-9afc446a6939 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:20.821247 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 244/511] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:20 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1666 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:20.821420 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6568437b-0697-4136-a76d-9afc446a6939 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:20.821420 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6568437b-0697-4136-a76d-9afc446a6939 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:20.821420 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6568437b-0697-4136-a76d-9afc446a6939 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:20.946506 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-6568437b-0697-4136-a76d-9afc446a6939 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:20.954837 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-6568437b-0697-4136-a76d-9afc446a6939 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1358 microversion: 2.1 time: 0.149818 Sep 23 15:24:20.955464 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 268/512] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:20 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:21.015648 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-cffeb797-5ceb-48b6-8f63-7906134e8d61 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:21.015648 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-cffeb797-5ceb-48b6-8f63-7906134e8d61 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:21.019337 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-cffeb797-5ceb-48b6-8f63-7906134e8d61 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:21.019820 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-cffeb797-5ceb-48b6-8f63-7906134e8d61 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:21.020356 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-cffeb797-5ceb-48b6-8f63-7906134e8d61 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:21.021552 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-cffeb797-5ceb-48b6-8f63-7906134e8d61 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:21.022023 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-cffeb797-5ceb-48b6-8f63-7906134e8d61 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:21.022473 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-cffeb797-5ceb-48b6-8f63-7906134e8d61 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:21.168602 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-cffeb797-5ceb-48b6-8f63-7906134e8d61 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:21.181523 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-cffeb797-5ceb-48b6-8f63-7906134e8d61 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1737 microversion: 2.1 time: 0.168998 Sep 23 15:24:21.181523 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 245/513] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:21 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:21.325996 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-56ab3c7b-2772-49df-8299-4ee9b05f172e req-01898f34-14d0-4f09-8138-c8fb9d59eb75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14c2bdac-30a5-4a8a-ad91-191c529f77df", "name": "network-vif-plugged", "status": "completed", "tag": "f8bb92b2-35e5-484a-adc2-f6309c059f45"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:21.335619 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-56ab3c7b-2772-49df-8299-4ee9b05f172e req-01898f34-14d0-4f09-8138-c8fb9d59eb75 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:21.336131 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-56ab3c7b-2772-49df-8299-4ee9b05f172e req-01898f34-14d0-4f09-8138-c8fb9d59eb75 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:21.336593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-56ab3c7b-2772-49df-8299-4ee9b05f172e req-01898f34-14d0-4f09-8138-c8fb9d59eb75 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:21.348675 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-56ab3c7b-2772-49df-8299-4ee9b05f172e req-01898f34-14d0-4f09-8138-c8fb9d59eb75 service nova] Creating event network-vif-plugged:f8bb92b2-35e5-484a-adc2-f6309c059f45 for instance 14c2bdac-30a5-4a8a-ad91-191c529f77df on hv-cinder-85530 Sep 23 15:24:21.353633 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-56ab3c7b-2772-49df-8299-4ee9b05f172e req-01898f34-14d0-4f09-8138-c8fb9d59eb75 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031976 Sep 23 15:24:21.354220 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 269/514] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:24:21.544740 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-e86dc98b-acea-4254-b84b-4acf78e784ae tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:21.545376 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-e86dc98b-acea-4254-b84b-4acf78e784ae tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:21.551943 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e86dc98b-acea-4254-b84b-4acf78e784ae tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:21.552477 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e86dc98b-acea-4254-b84b-4acf78e784ae tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:21.552925 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e86dc98b-acea-4254-b84b-4acf78e784ae tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:21.553629 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e86dc98b-acea-4254-b84b-4acf78e784ae tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:21.554096 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e86dc98b-acea-4254-b84b-4acf78e784ae tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:21.554554 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e86dc98b-acea-4254-b84b-4acf78e784ae tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:21.588416 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e86dc98b-acea-4254-b84b-4acf78e784ae tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:21.588918 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e86dc98b-acea-4254-b84b-4acf78e784ae tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:21.589409 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e86dc98b-acea-4254-b84b-4acf78e784ae tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:21.589876 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.objects.instance [None req-e86dc98b-acea-4254-b84b-4acf78e784ae tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lazy-loading 'fault' on Instance uuid 485ab2cf-cd2f-42e5-a625-bda9af6b99b5 {{(pid=121448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:24:21.633619 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-e86dc98b-acea-4254-b84b-4acf78e784ae tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:21.641889 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-e86dc98b-acea-4254-b84b-4acf78e784ae tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5" status: 200 len: 1309 microversion: 2.1 time: 0.101489 Sep 23 15:24:21.642467 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 246/515] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:21 2022] GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:21.978088 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a9bb7d19-f7d3-4187-be26-bdb00546e561 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:21.979444 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-a9bb7d19-f7d3-4187-be26-bdb00546e561 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:21.986167 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a9bb7d19-f7d3-4187-be26-bdb00546e561 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:21.986643 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a9bb7d19-f7d3-4187-be26-bdb00546e561 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:21.987069 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a9bb7d19-f7d3-4187-be26-bdb00546e561 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:21.987756 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a9bb7d19-f7d3-4187-be26-bdb00546e561 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:21.988219 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a9bb7d19-f7d3-4187-be26-bdb00546e561 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:21.988637 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a9bb7d19-f7d3-4187-be26-bdb00546e561 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:22.119927 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a9bb7d19-f7d3-4187-be26-bdb00546e561 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:22.128228 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-a9bb7d19-f7d3-4187-be26-bdb00546e561 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1358 microversion: 2.1 time: 0.154414 Sep 23 15:24:22.128835 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 270/516] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:21 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:22.200153 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-bf7f2055-781b-4a71-9174-d0245432af4f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:22.200807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-bf7f2055-781b-4a71-9174-d0245432af4f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:22.207097 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf7f2055-781b-4a71-9174-d0245432af4f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:22.207585 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf7f2055-781b-4a71-9174-d0245432af4f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:22.208038 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf7f2055-781b-4a71-9174-d0245432af4f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:22.208737 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf7f2055-781b-4a71-9174-d0245432af4f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:22.209191 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf7f2055-781b-4a71-9174-d0245432af4f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:22.209617 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf7f2055-781b-4a71-9174-d0245432af4f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:22.345489 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-bf7f2055-781b-4a71-9174-d0245432af4f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:22.354866 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-bf7f2055-781b-4a71-9174-d0245432af4f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1737 microversion: 2.1 time: 0.158581 Sep 23 15:24:22.355445 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 247/517] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:22 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:22.665364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-6129b6db-3c95-40f4-b318-2489670520f6 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:22.666018 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-6129b6db-3c95-40f4-b318-2489670520f6 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: 485ab2cf-cd2f-42e5-a625-bda9af6b99b5] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:22.671971 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6129b6db-3c95-40f4-b318-2489670520f6 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:22.672464 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6129b6db-3c95-40f4-b318-2489670520f6 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:22.672889 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6129b6db-3c95-40f4-b318-2489670520f6 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:22.673562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6129b6db-3c95-40f4-b318-2489670520f6 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:22.674004 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6129b6db-3c95-40f4-b318-2489670520f6 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:22.674414 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6129b6db-3c95-40f4-b318-2489670520f6 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:22.687720 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-6129b6db-3c95-40f4-b318-2489670520f6 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] HTTP exception thrown: Instance 485ab2cf-cd2f-42e5-a625-bda9af6b99b5 could not be found. Sep 23 15:24:22.689384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-6129b6db-3c95-40f4-b318-2489670520f6 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Request method failure captured: Sep 23 15:24:22.689384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5 HTTP/1.1 Sep 23 15:24:22.689384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:24:22.689384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:24:22.689384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:24:22.689384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:24:22.689384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:24:22.689384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:24:22.689384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:24:22.689384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:24:22.689384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLc9BdPT7UOwhvdG4kOdodh7E68UjR9IbfeUmL7WA-Rl7SEsqZCN-uO9HzPMxwdEjoJCP_rQixEn6ZLLUm-grWTurzKFJA4SZ3UdDx8anSma40u9N4eZw2vVJWuviRXIuh05PY6yr220RjQ-466_t7SnyqJFE15vjBnW_BEfKg8Sf29A Sep 23 15:24:22.689384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:24:22.689384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:24:22.689384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:24:22.689384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:24:22.689384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:24:22.689384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:24:22.689384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: c9488f4d4af441168341205e0e936ce4 Sep 23 15:24:22.689384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-VolumesSnapshotTestJSON-712624210 Sep 23 15:24:22.689384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:24:22.689384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:24:22.691057 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/c9488f4d4af441168341205e0e936ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c9488f4d4af441168341205e0e936ce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_c9488f4d4af441168341205e0e936ce4", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c9488f4d4af441168341205e0e936ce4"}]}] Sep 23 15:24:22.691057 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-VolumesSnapshotTestJSON-712624210 Sep 23 15:24:22.691057 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: c9488f4d4af441168341205e0e936ce4 Sep 23 15:24:22.691057 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-712624210 Sep 23 15:24:22.691057 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-VolumesSnapshotTestJSON-712624210-project Sep 23 15:24:22.691057 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:24:22.691057 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:24:22.691057 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: ee65edb3211b4b71a771594a90a342ff Sep 23 15:24:22.691057 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-VolumesSnapshotTestJSON-712624210-project Sep 23 15:24:22.691057 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:24:22.691057 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance 485ab2cf-cd2f-42e5-a625-bda9af6b99b5 could not be found. Sep 23 15:24:22.691057 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '485ab2cf-cd2f-42e5-a625-bda9af6b99b5'} Sep 23 15:24:22.692226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:24:22.692226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:24:22.692226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:24:22.692226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:24:22.692226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:24:22.692226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:24:22.692226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:24:22.692226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:24:22.692226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:24:22.692226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:24:22.692226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 485ab2cf-cd2f-42e5-a625-bda9af6b99b5 could not be found. Sep 23 15:24:22.692226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:24:22.692226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:24:22.692226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:24:22.692226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:24:22.692226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:24:22.692226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:24:22.692226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:24:22.692226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:24:22.692226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:24:22.693757 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:24:22.693757 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:24:22.693757 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:24:22.693757 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:24:22.693757 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:24:22.693757 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:24:22.693757 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:24:22.693757 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 485ab2cf-cd2f-42e5-a625-bda9af6b99b5 could not be found. Sep 23 15:24:22.693757 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:24:22.693757 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:24:22.693757 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:24:22.693757 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:24:22.693757 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:24:22.693757 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:24:22.693757 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:24:22.693757 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:24:22.693757 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 485ab2cf-cd2f-42e5-a625-bda9af6b99b5 could not be found. Sep 23 15:24:22.693757 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:24:22.695073 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-6129b6db-3c95-40f4-b318-2489670520f6 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Returning 404 to user: Instance 485ab2cf-cd2f-42e5-a625-bda9af6b99b5 could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:24:22.695073 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-6129b6db-3c95-40f4-b318-2489670520f6 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5" status: 404 len: 111 microversion: 2.1 time: 0.029357 Sep 23 15:24:22.695073 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 271/518] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:22 2022] GET /compute/v2.1/servers/485ab2cf-cd2f-42e5-a625-bda9af6b99b5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:24:23.150618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-28fce15c-697f-4187-b404-e9aff83398ba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:23.151323 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-28fce15c-697f-4187-b404-e9aff83398ba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:23.157711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-28fce15c-697f-4187-b404-e9aff83398ba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:23.158191 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-28fce15c-697f-4187-b404-e9aff83398ba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:23.158629 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-28fce15c-697f-4187-b404-e9aff83398ba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:23.159322 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-28fce15c-697f-4187-b404-e9aff83398ba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:23.159781 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-28fce15c-697f-4187-b404-e9aff83398ba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:23.160241 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-28fce15c-697f-4187-b404-e9aff83398ba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:23.298626 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-28fce15c-697f-4187-b404-e9aff83398ba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:23.307388 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-28fce15c-697f-4187-b404-e9aff83398ba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1358 microversion: 2.1 time: 0.159869 Sep 23 15:24:23.308325 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 248/519] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:23 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:23.378539 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-6e4ff5a0-76d1-4eab-976b-4878166462c2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:23.379170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-6e4ff5a0-76d1-4eab-976b-4878166462c2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:23.385666 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e4ff5a0-76d1-4eab-976b-4878166462c2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:23.386140 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e4ff5a0-76d1-4eab-976b-4878166462c2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:23.386572 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e4ff5a0-76d1-4eab-976b-4878166462c2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:23.387249 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e4ff5a0-76d1-4eab-976b-4878166462c2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:23.387697 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e4ff5a0-76d1-4eab-976b-4878166462c2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:23.388157 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e4ff5a0-76d1-4eab-976b-4878166462c2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:23.517057 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-6e4ff5a0-76d1-4eab-976b-4878166462c2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:23.526032 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-6e4ff5a0-76d1-4eab-976b-4878166462c2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1737 microversion: 2.1 time: 0.151461 Sep 23 15:24:23.526942 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 272/520] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:23 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:24.331159 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-add50148-ff62-46c2-8414-f3dcdd5ac193 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:24.331768 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-add50148-ff62-46c2-8414-f3dcdd5ac193 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:24.338969 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-add50148-ff62-46c2-8414-f3dcdd5ac193 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:24.339431 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-add50148-ff62-46c2-8414-f3dcdd5ac193 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:24.339865 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-add50148-ff62-46c2-8414-f3dcdd5ac193 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:24.340580 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-add50148-ff62-46c2-8414-f3dcdd5ac193 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:24.341031 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-add50148-ff62-46c2-8414-f3dcdd5ac193 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:24.341457 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-add50148-ff62-46c2-8414-f3dcdd5ac193 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:24.471014 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-add50148-ff62-46c2-8414-f3dcdd5ac193 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:24.478984 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-add50148-ff62-46c2-8414-f3dcdd5ac193 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1549 microversion: 2.1 time: 0.151345 Sep 23 15:24:24.479245 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 249/521] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:24 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:24.501597 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-302a6a47-cd41-47fe-ba92-d3017962bd2c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:24.502301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-302a6a47-cd41-47fe-ba92-d3017962bd2c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:24.509084 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-302a6a47-cd41-47fe-ba92-d3017962bd2c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:24.509581 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-302a6a47-cd41-47fe-ba92-d3017962bd2c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:24.510649 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-302a6a47-cd41-47fe-ba92-d3017962bd2c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:24.511356 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-302a6a47-cd41-47fe-ba92-d3017962bd2c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:24.511807 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-302a6a47-cd41-47fe-ba92-d3017962bd2c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:24.512259 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-302a6a47-cd41-47fe-ba92-d3017962bd2c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:24.550757 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-8e9c2955-a495-4352-b279-f7c43f15f064 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:24.551369 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-8e9c2955-a495-4352-b279-f7c43f15f064 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:24.558697 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8e9c2955-a495-4352-b279-f7c43f15f064 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:24.559192 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8e9c2955-a495-4352-b279-f7c43f15f064 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:24.559635 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8e9c2955-a495-4352-b279-f7c43f15f064 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:24.560407 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8e9c2955-a495-4352-b279-f7c43f15f064 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:24.560874 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8e9c2955-a495-4352-b279-f7c43f15f064 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:24.561303 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8e9c2955-a495-4352-b279-f7c43f15f064 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:24.650087 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-302a6a47-cd41-47fe-ba92-d3017962bd2c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:24.658739 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-302a6a47-cd41-47fe-ba92-d3017962bd2c tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1549 microversion: 2.1 time: 0.161118 Sep 23 15:24:24.659434 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 273/522] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:24 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1549 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:24.680838 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-eb4febaf-3fbe-4a55-b196-48e71f8d2a98 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:24.686462 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-eb4febaf-3fbe-4a55-b196-48e71f8d2a98 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:24.687370 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-eb4febaf-3fbe-4a55-b196-48e71f8d2a98 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Searching by: {'deleted': False, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937'} {{(pid=121450) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 15:24:24.694805 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eb4febaf-3fbe-4a55-b196-48e71f8d2a98 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:24.695287 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eb4febaf-3fbe-4a55-b196-48e71f8d2a98 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:24.695721 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eb4febaf-3fbe-4a55-b196-48e71f8d2a98 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:24.696477 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eb4febaf-3fbe-4a55-b196-48e71f8d2a98 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:24.696929 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eb4febaf-3fbe-4a55-b196-48e71f8d2a98 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:24.698130 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eb4febaf-3fbe-4a55-b196-48e71f8d2a98 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:24.709835 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-8e9c2955-a495-4352-b279-f7c43f15f064 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:24.717832 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-8e9c2955-a495-4352-b279-f7c43f15f064 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1737 microversion: 2.1 time: 0.170992 Sep 23 15:24:24.718405 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 250/523] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:24 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:24.790467 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.multi_cell_list [None req-eb4febaf-3fbe-4a55-b196-48e71f8d2a98 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121450) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 15:24:24.888131 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-eb4febaf-3fbe-4a55-b196-48e71f8d2a98 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.210924 Sep 23 15:24:24.888634 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 274/524] 10.222.0.55 () {58 vars in 1125 bytes} [Fri Sep 23 15:24:24 2022] GET /compute/v2.1/servers => generated 342 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:24:24.900471 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-8a24780f-349a-4a66-b930-cc6ea07ca0d4 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:24.901108 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-8a24780f-349a-4a66-b930-cc6ea07ca0d4 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:24.907067 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8a24780f-349a-4a66-b930-cc6ea07ca0d4 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:24.910116 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8a24780f-349a-4a66-b930-cc6ea07ca0d4 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:24.910116 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8a24780f-349a-4a66-b930-cc6ea07ca0d4 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:24.910116 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8a24780f-349a-4a66-b930-cc6ea07ca0d4 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:24.910116 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8a24780f-349a-4a66-b930-cc6ea07ca0d4 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:24.910496 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8a24780f-349a-4a66-b930-cc6ea07ca0d4 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:25.038057 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-8a24780f-349a-4a66-b930-cc6ea07ca0d4 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:25.046565 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-8a24780f-349a-4a66-b930-cc6ea07ca0d4 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1549 microversion: 2.1 time: 0.150015 Sep 23 15:24:25.047193 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 251/525] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:24 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:25.741186 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-cc0f2542-fb31-46d9-b895-e30f7b228e0e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:25.741799 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-cc0f2542-fb31-46d9-b895-e30f7b228e0e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:25.748589 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cc0f2542-fb31-46d9-b895-e30f7b228e0e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:25.752202 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cc0f2542-fb31-46d9-b895-e30f7b228e0e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:25.752202 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cc0f2542-fb31-46d9-b895-e30f7b228e0e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:25.752202 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cc0f2542-fb31-46d9-b895-e30f7b228e0e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:25.752202 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cc0f2542-fb31-46d9-b895-e30f7b228e0e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:25.752856 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cc0f2542-fb31-46d9-b895-e30f7b228e0e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:25.755567 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:25.882833 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-cc0f2542-fb31-46d9-b895-e30f7b228e0e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:25.892392 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-cc0f2542-fb31-46d9-b895-e30f7b228e0e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1737 microversion: 2.1 time: 0.155190 Sep 23 15:24:25.892962 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 275/526] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:25 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:26.917896 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-64200742-3d6f-4d58-9703-b4f2dcb18dbc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:26.918495 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-64200742-3d6f-4d58-9703-b4f2dcb18dbc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:26.925083 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-64200742-3d6f-4d58-9703-b4f2dcb18dbc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:26.931025 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-64200742-3d6f-4d58-9703-b4f2dcb18dbc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:26.931025 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-64200742-3d6f-4d58-9703-b4f2dcb18dbc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:26.931025 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-64200742-3d6f-4d58-9703-b4f2dcb18dbc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:26.931025 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-64200742-3d6f-4d58-9703-b4f2dcb18dbc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:26.931666 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-64200742-3d6f-4d58-9703-b4f2dcb18dbc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:27.060871 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-64200742-3d6f-4d58-9703-b4f2dcb18dbc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:27.069918 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-64200742-3d6f-4d58-9703-b4f2dcb18dbc tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1737 microversion: 2.1 time: 0.156442 Sep 23 15:24:27.070496 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 252/527] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:26 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:27.229330 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-0b609172-85ee-40bb-89e6-605a14461257 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c1b54a7-1626-4cff-ae22-12dac645ade7"}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:27.231768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-0b609172-85ee-40bb-89e6-605a14461257 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:27.239381 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0b609172-85ee-40bb-89e6-605a14461257 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:27.239862 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0b609172-85ee-40bb-89e6-605a14461257 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:27.240369 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0b609172-85ee-40bb-89e6-605a14461257 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:27.241067 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0b609172-85ee-40bb-89e6-605a14461257 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:27.241519 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0b609172-85ee-40bb-89e6-605a14461257 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:27.241951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0b609172-85ee-40bb-89e6-605a14461257 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:28.095644 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-7c5ee86b-b1e4-4800-9e2f-962a2689637a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:28.096628 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-7c5ee86b-b1e4-4800-9e2f-962a2689637a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:28.104324 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7c5ee86b-b1e4-4800-9e2f-962a2689637a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:28.104813 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7c5ee86b-b1e4-4800-9e2f-962a2689637a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:28.105248 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7c5ee86b-b1e4-4800-9e2f-962a2689637a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:28.106038 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7c5ee86b-b1e4-4800-9e2f-962a2689637a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:28.106493 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7c5ee86b-b1e4-4800-9e2f-962a2689637a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:28.106934 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7c5ee86b-b1e4-4800-9e2f-962a2689637a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:28.192505 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-0b609172-85ee-40bb-89e6-605a14461257 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "POST /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.967839 Sep 23 15:24:28.193277 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 276/528] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Sep 23 15:24:27 2022] POST /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df/os-volume_attachments => generated 194 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:24:28.263331 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-7c5ee86b-b1e4-4800-9e2f-962a2689637a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:28.272793 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-7c5ee86b-b1e4-4800-9e2f-962a2689637a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1737 microversion: 2.1 time: 0.182542 Sep 23 15:24:28.273367 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 253/529] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:28 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:29.299416 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-8c35a1a2-a917-444e-b13c-dbe337f0c86e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:29.302157 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-8c35a1a2-a917-444e-b13c-dbe337f0c86e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:29.307066 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c35a1a2-a917-444e-b13c-dbe337f0c86e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:29.307554 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c35a1a2-a917-444e-b13c-dbe337f0c86e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:29.308007 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c35a1a2-a917-444e-b13c-dbe337f0c86e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:29.308710 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c35a1a2-a917-444e-b13c-dbe337f0c86e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:29.309251 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c35a1a2-a917-444e-b13c-dbe337f0c86e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:29.309669 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c35a1a2-a917-444e-b13c-dbe337f0c86e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:29.445664 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-8c35a1a2-a917-444e-b13c-dbe337f0c86e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:29.454162 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-8c35a1a2-a917-444e-b13c-dbe337f0c86e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1737 microversion: 2.1 time: 0.159907 Sep 23 15:24:29.454774 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 277/530] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:29 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:30.477635 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-91ed34dd-cd18-4b52-8782-7e2cf072f689 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:30.479196 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-91ed34dd-cd18-4b52-8782-7e2cf072f689 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:30.485465 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-91ed34dd-cd18-4b52-8782-7e2cf072f689 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:30.485974 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-91ed34dd-cd18-4b52-8782-7e2cf072f689 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:30.486507 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-91ed34dd-cd18-4b52-8782-7e2cf072f689 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:30.487194 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-91ed34dd-cd18-4b52-8782-7e2cf072f689 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:30.487642 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-91ed34dd-cd18-4b52-8782-7e2cf072f689 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:30.488093 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-91ed34dd-cd18-4b52-8782-7e2cf072f689 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:30.618502 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-91ed34dd-cd18-4b52-8782-7e2cf072f689 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:30.627672 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-91ed34dd-cd18-4b52-8782-7e2cf072f689 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1737 microversion: 2.1 time: 0.153787 Sep 23 15:24:30.628308 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 254/531] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:30 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:31.652778 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-437a92c6-b1d3-4714-969d-3ecccaf25028 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:31.653413 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-437a92c6-b1d3-4714-969d-3ecccaf25028 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:31.655874 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:31.660769 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-437a92c6-b1d3-4714-969d-3ecccaf25028 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:31.661273 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-437a92c6-b1d3-4714-969d-3ecccaf25028 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:31.661703 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-437a92c6-b1d3-4714-969d-3ecccaf25028 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:31.662389 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-437a92c6-b1d3-4714-969d-3ecccaf25028 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:31.662833 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-437a92c6-b1d3-4714-969d-3ecccaf25028 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:31.663244 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-437a92c6-b1d3-4714-969d-3ecccaf25028 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:31.792434 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-437a92c6-b1d3-4714-969d-3ecccaf25028 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:31.800909 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-437a92c6-b1d3-4714-969d-3ecccaf25028 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1737 microversion: 2.1 time: 0.153412 Sep 23 15:24:31.801480 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 278/532] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:31 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:32.825633 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a373cf06-f42c-41e7-aaf5-b22b9db75a7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:32.826291 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-a373cf06-f42c-41e7-aaf5-b22b9db75a7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:32.832858 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a373cf06-f42c-41e7-aaf5-b22b9db75a7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:32.833341 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a373cf06-f42c-41e7-aaf5-b22b9db75a7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:32.833778 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a373cf06-f42c-41e7-aaf5-b22b9db75a7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:32.834466 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a373cf06-f42c-41e7-aaf5-b22b9db75a7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:32.834920 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a373cf06-f42c-41e7-aaf5-b22b9db75a7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:32.835344 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a373cf06-f42c-41e7-aaf5-b22b9db75a7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:32.966988 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a373cf06-f42c-41e7-aaf5-b22b9db75a7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:32.975254 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-a373cf06-f42c-41e7-aaf5-b22b9db75a7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1737 microversion: 2.1 time: 0.153995 Sep 23 15:24:32.975823 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 255/533] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:32 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:33.281060 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-756a6c65-3271-4600-83c4-e0c79989a1f0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1400695165", "imageRef": "051c4746-7f50-4edb-b09d-a8935df360de", "flavorRef": "452", "networks": [{"uuid": "5d0889b4-33f0-4d83-abe3-fa2925a19a90"}]}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:33.336925 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.network.neutron [None req-756a6c65-3271-4600-83c4-e0c79989a1f0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] validate_networks() for [('5d0889b4-33f0-4d83-abe3-fa2925a19a90', None, None, None, None, None)] {{(pid=121450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:24:33.995527 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-756a6c65-3271-4600-83c4-e0c79989a1f0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Flavor limits 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:24:33.995955 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-756a6c65-3271-4600-83c4-e0c79989a1f0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Image limits 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:24:33.996463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-756a6c65-3271-4600-83c4-e0c79989a1f0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Flavor pref 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:24:33.996876 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-756a6c65-3271-4600-83c4-e0c79989a1f0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Image pref 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:24:33.997290 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-756a6c65-3271-4600-83c4-e0c79989a1f0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:24:34.000476 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-1fa036e1-580c-4ceb-9431-6ddd592b9139 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:34.001163 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-1fa036e1-580c-4ceb-9431-6ddd592b9139 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:34.006508 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-756a6c65-3271-4600-83c4-e0c79989a1f0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:34.006988 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-756a6c65-3271-4600-83c4-e0c79989a1f0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:34.007406 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1fa036e1-580c-4ceb-9431-6ddd592b9139 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:34.007524 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-756a6c65-3271-4600-83c4-e0c79989a1f0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:34.007932 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1fa036e1-580c-4ceb-9431-6ddd592b9139 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:34.008169 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-756a6c65-3271-4600-83c4-e0c79989a1f0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:34.011538 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1fa036e1-580c-4ceb-9431-6ddd592b9139 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:34.011657 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-756a6c65-3271-4600-83c4-e0c79989a1f0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:34.011657 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-756a6c65-3271-4600-83c4-e0c79989a1f0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:34.011832 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1fa036e1-580c-4ceb-9431-6ddd592b9139 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:34.011832 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1fa036e1-580c-4ceb-9431-6ddd592b9139 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:34.011832 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1fa036e1-580c-4ceb-9431-6ddd592b9139 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:34.026844 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-756a6c65-3271-4600-83c4-e0c79989a1f0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Getting quotas for project c9488f4d4af441168341205e0e936ce4. Resources: {'ram', 'instances', 'cores'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:24:34.030928 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-756a6c65-3271-4600-83c4-e0c79989a1f0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Getting quotas for user ee65edb3211b4b71a771594a90a342ff and project c9488f4d4af441168341205e0e936ce4. Resources: {'ram', 'instances', 'cores'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:24:34.042810 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-756a6c65-3271-4600-83c4-e0c79989a1f0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Going to run 1 instances... {{(pid=121450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:24:34.045153 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-756a6c65-3271-4600-83c4-e0c79989a1f0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: f68f898c-130d-4eec-853c-db3269cb0fe4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='051c4746-7f50-4edb-b09d-a8935df360de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:24:34.140765 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-1fa036e1-580c-4ceb-9431-6ddd592b9139 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:34.149184 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-1fa036e1-580c-4ceb-9431-6ddd592b9139 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1737 microversion: 2.1 time: 0.152561 Sep 23 15:24:34.150269 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 256/534] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:33 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:34.221761 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-756a6c65-3271-4600-83c4-e0c79989a1f0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.945079 Sep 23 15:24:34.222419 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 279/535] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Sep 23 15:24:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:24:34.234812 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-5237d407-eab4-4e80-a191-862fdc99db89 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:34.235429 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-5237d407-eab4-4e80-a191-862fdc99db89 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: f68f898c-130d-4eec-853c-db3269cb0fe4] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:34.291175 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-5237d407-eab4-4e80-a191-862fdc99db89 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:34.298615 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-5237d407-eab4-4e80-a191-862fdc99db89 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4" status: 200 len: 1219 microversion: 2.1 time: 0.067772 Sep 23 15:24:34.299196 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 257/536] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:34 2022] GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:35.175677 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-bbf90ed0-597a-4f00-a9dd-92d2487f8f3f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:35.176515 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-bbf90ed0-597a-4f00-a9dd-92d2487f8f3f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:35.186504 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bbf90ed0-597a-4f00-a9dd-92d2487f8f3f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:35.187042 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bbf90ed0-597a-4f00-a9dd-92d2487f8f3f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:35.187483 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bbf90ed0-597a-4f00-a9dd-92d2487f8f3f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:35.188217 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bbf90ed0-597a-4f00-a9dd-92d2487f8f3f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:35.188672 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bbf90ed0-597a-4f00-a9dd-92d2487f8f3f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:35.189096 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bbf90ed0-597a-4f00-a9dd-92d2487f8f3f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:35.321981 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-57f07c60-5c3d-4288-83f9-119ce4b45095 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:35.322930 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-57f07c60-5c3d-4288-83f9-119ce4b45095 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: f68f898c-130d-4eec-853c-db3269cb0fe4] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:35.329096 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-bbf90ed0-597a-4f00-a9dd-92d2487f8f3f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:35.329624 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-57f07c60-5c3d-4288-83f9-119ce4b45095 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:35.330109 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-57f07c60-5c3d-4288-83f9-119ce4b45095 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:35.330546 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-57f07c60-5c3d-4288-83f9-119ce4b45095 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:35.331244 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-57f07c60-5c3d-4288-83f9-119ce4b45095 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:35.331695 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-57f07c60-5c3d-4288-83f9-119ce4b45095 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:35.332158 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-57f07c60-5c3d-4288-83f9-119ce4b45095 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:35.338450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-bbf90ed0-597a-4f00-a9dd-92d2487f8f3f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1737 microversion: 2.1 time: 0.167924 Sep 23 15:24:35.338973 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 280/537] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:35 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:35.397551 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-57f07c60-5c3d-4288-83f9-119ce4b45095 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:35.405588 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-57f07c60-5c3d-4288-83f9-119ce4b45095 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4" status: 200 len: 1223 microversion: 2.1 time: 0.088067 Sep 23 15:24:35.406153 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 258/538] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:35 2022] GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:36.362601 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b3a58178-b028-49b3-ab47-55ae936f7e11 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:36.363147 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-b3a58178-b028-49b3-ab47-55ae936f7e11 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:36.370636 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b3a58178-b028-49b3-ab47-55ae936f7e11 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:36.371144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b3a58178-b028-49b3-ab47-55ae936f7e11 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:36.371586 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b3a58178-b028-49b3-ab47-55ae936f7e11 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:36.372336 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b3a58178-b028-49b3-ab47-55ae936f7e11 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:36.372793 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b3a58178-b028-49b3-ab47-55ae936f7e11 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:36.373248 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b3a58178-b028-49b3-ab47-55ae936f7e11 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:36.429381 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-123d7bb4-fa01-44ce-ae77-dd76f8f583c0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:36.430002 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-123d7bb4-fa01-44ce-ae77-dd76f8f583c0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: f68f898c-130d-4eec-853c-db3269cb0fe4] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:36.437447 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-123d7bb4-fa01-44ce-ae77-dd76f8f583c0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:36.437945 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-123d7bb4-fa01-44ce-ae77-dd76f8f583c0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:36.438391 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-123d7bb4-fa01-44ce-ae77-dd76f8f583c0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:36.439106 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-123d7bb4-fa01-44ce-ae77-dd76f8f583c0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:36.439567 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-123d7bb4-fa01-44ce-ae77-dd76f8f583c0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:36.440097 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-123d7bb4-fa01-44ce-ae77-dd76f8f583c0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:36.517458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-123d7bb4-fa01-44ce-ae77-dd76f8f583c0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:36.518849 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-b3a58178-b028-49b3-ab47-55ae936f7e11 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:36.530010 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-b3a58178-b028-49b3-ab47-55ae936f7e11 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1717 microversion: 2.1 time: 0.171344 Sep 23 15:24:36.530594 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 281/539] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:36 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1717 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:36.533479 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-123d7bb4-fa01-44ce-ae77-dd76f8f583c0 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4" status: 200 len: 1215 microversion: 2.1 time: 0.107887 Sep 23 15:24:36.534241 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 259/540] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:36 2022] GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4 => generated 1215 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:36.647597 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-647bdaec-3885-43b4-8fe3-2055c1ef0181 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:36.648133 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-647bdaec-3885-43b4-8fe3-2055c1ef0181 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:36.654105 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-647bdaec-3885-43b4-8fe3-2055c1ef0181 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:36.654590 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-647bdaec-3885-43b4-8fe3-2055c1ef0181 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:36.655065 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-647bdaec-3885-43b4-8fe3-2055c1ef0181 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:36.655757 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-647bdaec-3885-43b4-8fe3-2055c1ef0181 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:36.656245 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-647bdaec-3885-43b4-8fe3-2055c1ef0181 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:36.656676 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-647bdaec-3885-43b4-8fe3-2055c1ef0181 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:36.735884 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=100 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:36.739922 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.wsgi [None req-647bdaec-3885-43b4-8fe3-2055c1ef0181 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] HTTP exception thrown: Cannot 'detach_volume' instance 7d2de5a1-7ae9-4010-a7fc-5d2f45212418 while it is in vm_state rescued Sep 23 15:24:36.741562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-647bdaec-3885-43b4-8fe3-2055c1ef0181 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Request method failure captured: Sep 23 15:24:36.741562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: request: DELETE /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/os-volume_attachments/d4e45e19-dd49-4cb5-ac88-ad010ec221b6 HTTP/1.1 Sep 23 15:24:36.741562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept: application/json Sep 23 15:24:36.741562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept-Encoding: identity Sep 23 15:24:36.741562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Connection: close Sep 23 15:24:36.741562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Length: 0 Sep 23 15:24:36.741562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Type: application/json Sep 23 15:24:36.741562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Host: 10.222.0.55 Sep 23 15:24:36.741562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Openstack-System-Scope: None Sep 23 15:24:36.741562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: User-Agent: python-urllib3/1.26.12 Sep 23 15:24:36.741562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Auth-Token: gAAAAABjLc6x1LAOulyIycgRWUTc_jBmYLdDkQeiPfEhd77MBPxxixMXuHzzzsoTpzWc9k5txbSC3yFLrYFV49oF9-wag1dL88k2AX-bXsZGWgKX7IVmHTshTzZJzO_SpP3I_fgqCNWPxP9LPw1RpnK99IMWBDohTuycUChJ76IguAfj1MEZ7Hw Sep 23 15:24:36.741562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Id: None Sep 23 15:24:36.741562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Name: None Sep 23 15:24:36.741562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Identity-Status: Confirmed Sep 23 15:24:36.741562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Is-Admin-Project: True Sep 23 15:24:36.741562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Id: default Sep 23 15:24:36.741562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Name: Default Sep 23 15:24:36.741562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Id: a079aa0c75bf44619342f53006d88ff9 Sep 23 15:24:36.741562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-717875198 Sep 23 15:24:36.741562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Role: reader,member Sep 23 15:24:36.741562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Roles: reader,member Sep 23 15:24:36.743182 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a079aa0c75bf44619342f53006d88ff9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a079aa0c75bf44619342f53006d88ff9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a079aa0c75bf44619342f53006d88ff9", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a079aa0c75bf44619342f53006d88ff9"}]}] Sep 23 15:24:36.743182 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant: tempest-ServerRescueNegativeTestJSON-717875198 Sep 23 15:24:36.743182 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Id: a079aa0c75bf44619342f53006d88ff9 Sep 23 15:24:36.743182 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-717875198 Sep 23 15:24:36.743182 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User: tempest-ServerRescueNegativeTestJSON-717875198-project Sep 23 15:24:36.743182 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Id: default Sep 23 15:24:36.743182 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Name: Default Sep 23 15:24:36.743182 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Id: a5514abdc8b54282901367a4f2d02856 Sep 23 15:24:36.743182 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Name: tempest-ServerRescueNegativeTestJSON-717875198-project Sep 23 15:24:36.743182 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: method: > Sep 23 15:24:36.743182 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: exception: Cannot 'detach_volume' instance 7d2de5a1-7ae9-4010-a7fc-5d2f45212418 while it is in vm_state rescued Sep 23 15:24:36.744760 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: action_args: {'server_id': '7d2de5a1-7ae9-4010-a7fc-5d2f45212418', 'id': 'd4e45e19-dd49-4cb5-ac88-ad010ec221b6'} Sep 23 15:24:36.744760 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:24:36.744760 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:24:36.744760 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 23 15:24:36.744760 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 23 15:24:36.744760 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 15:24:36.744760 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 15:24:36.744760 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 15:24:36.744760 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 15:24:36.744760 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7d2de5a1-7ae9-4010-a7fc-5d2f45212418 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 23 15:24:36.744760 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:24:36.744760 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:24:36.744760 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:24:36.744760 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:24:36.744760 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:24:36.744760 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:24:36.744760 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:24:36.744760 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:24:36.744760 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:24:36.744760 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:24:36.746617 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 23 15:24:36.746617 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 15:24:36.746617 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 15:24:36.746617 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 15:24:36.746617 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7d2de5a1-7ae9-4010-a7fc-5d2f45212418 while it is in vm_state rescued Sep 23 15:24:36.746617 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:24:36.746617 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:24:36.746617 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:24:36.746617 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:24:36.746617 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:24:36.746617 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:24:36.746617 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:24:36.746617 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:24:36.746617 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7d2de5a1-7ae9-4010-a7fc-5d2f45212418 while it is in vm_state rescued Sep 23 15:24:36.746617 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:24:36.746617 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-647bdaec-3885-43b4-8fe3-2055c1ef0181 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Returning 409 to user: Cannot 'detach_volume' instance 7d2de5a1-7ae9-4010-a7fc-5d2f45212418 while it is in vm_state rescued {{(pid=121448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:24:36.747750 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-647bdaec-3885-43b4-8fe3-2055c1ef0181 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "DELETE /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/os-volume_attachments/d4e45e19-dd49-4cb5-ac88-ad010ec221b6" status: 409 len: 152 microversion: 2.1 time: 0.099447 Sep 23 15:24:36.747750 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 260/541] 10.222.0.55 () {58 vars in 1416 bytes} [Fri Sep 23 15:24:36 2022] DELETE /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/os-volume_attachments/d4e45e19-dd49-4cb5-ac88-ad010ec221b6 => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 15:24:36.753198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-e5e51c03-a149-41b6-9a88-797f1417ce61 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:36.753732 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-e5e51c03-a149-41b6-9a88-797f1417ce61 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:36.760603 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e5e51c03-a149-41b6-9a88-797f1417ce61 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:36.761092 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e5e51c03-a149-41b6-9a88-797f1417ce61 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:36.761518 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e5e51c03-a149-41b6-9a88-797f1417ce61 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:36.762599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e5e51c03-a149-41b6-9a88-797f1417ce61 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:36.763058 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e5e51c03-a149-41b6-9a88-797f1417ce61 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:36.763479 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e5e51c03-a149-41b6-9a88-797f1417ce61 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:37.028908 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-e5e51c03-a149-41b6-9a88-797f1417ce61 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "POST /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/action" status: 202 len: 0 microversion: 2.1 time: 0.279716 Sep 23 15:24:37.029619 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 282/542] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Sep 23 15:24:36 2022] POST /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:24:37.037732 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6e842105-1864-4908-b8dd-829095c6db43 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:37.038340 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-6e842105-1864-4908-b8dd-829095c6db43 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:37.045436 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6e842105-1864-4908-b8dd-829095c6db43 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:37.045925 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6e842105-1864-4908-b8dd-829095c6db43 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:37.046360 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6e842105-1864-4908-b8dd-829095c6db43 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:37.047050 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6e842105-1864-4908-b8dd-829095c6db43 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:37.047508 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6e842105-1864-4908-b8dd-829095c6db43 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:37.047935 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6e842105-1864-4908-b8dd-829095c6db43 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:37.184290 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6e842105-1864-4908-b8dd-829095c6db43 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:37.188899 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-6e842105-1864-4908-b8dd-829095c6db43 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1725 microversion: 2.1 time: 0.154889 Sep 23 15:24:37.189600 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 261/543] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:37 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:37.559066 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-60873a65-2a0e-4bbe-9a6e-ec9244846408 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:37.562714 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-60873a65-2a0e-4bbe-9a6e-ec9244846408 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: f68f898c-130d-4eec-853c-db3269cb0fe4] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:37.570757 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-60873a65-2a0e-4bbe-9a6e-ec9244846408 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:37.572089 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-60873a65-2a0e-4bbe-9a6e-ec9244846408 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:37.572868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-60873a65-2a0e-4bbe-9a6e-ec9244846408 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:37.573798 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-60873a65-2a0e-4bbe-9a6e-ec9244846408 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:37.574801 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-60873a65-2a0e-4bbe-9a6e-ec9244846408 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:37.575551 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-60873a65-2a0e-4bbe-9a6e-ec9244846408 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:37.679856 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-60873a65-2a0e-4bbe-9a6e-ec9244846408 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:37.687795 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-60873a65-2a0e-4bbe-9a6e-ec9244846408 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4" status: 200 len: 1271 microversion: 2.1 time: 0.133629 Sep 23 15:24:37.688398 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 283/544] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:37 2022] GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4 => generated 1271 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:38.000404 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-4a9d3e33-a35f-4c1a-95a3-d892a4fa80d2 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:38.002670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-4a9d3e33-a35f-4c1a-95a3-d892a4fa80d2 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:38.012400 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4a9d3e33-a35f-4c1a-95a3-d892a4fa80d2 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:38.013248 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4a9d3e33-a35f-4c1a-95a3-d892a4fa80d2 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:38.013881 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4a9d3e33-a35f-4c1a-95a3-d892a4fa80d2 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:38.016202 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4a9d3e33-a35f-4c1a-95a3-d892a4fa80d2 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:38.016202 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4a9d3e33-a35f-4c1a-95a3-d892a4fa80d2 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:38.016202 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4a9d3e33-a35f-4c1a-95a3-d892a4fa80d2 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:38.154639 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-4a9d3e33-a35f-4c1a-95a3-d892a4fa80d2 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:38.163031 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-4a9d3e33-a35f-4c1a-95a3-d892a4fa80d2 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1595 microversion: 2.1 time: 0.167087 Sep 23 15:24:38.163607 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 262/545] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:37 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1595 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:38.213343 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-8aab8a07-08e7-4f04-8a51-88ffd2b4d123 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:38.213965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-8aab8a07-08e7-4f04-8a51-88ffd2b4d123 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:38.220345 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8aab8a07-08e7-4f04-8a51-88ffd2b4d123 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:38.220850 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8aab8a07-08e7-4f04-8a51-88ffd2b4d123 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:38.221279 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8aab8a07-08e7-4f04-8a51-88ffd2b4d123 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:38.222016 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8aab8a07-08e7-4f04-8a51-88ffd2b4d123 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:38.222501 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8aab8a07-08e7-4f04-8a51-88ffd2b4d123 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:38.222956 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8aab8a07-08e7-4f04-8a51-88ffd2b4d123 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:38.438674 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-8aab8a07-08e7-4f04-8a51-88ffd2b4d123 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:38.447303 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-8aab8a07-08e7-4f04-8a51-88ffd2b4d123 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1725 microversion: 2.1 time: 0.238387 Sep 23 15:24:38.448020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 284/546] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:38 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1725 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:38.713208 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-16884637-1847-4e7d-918b-b82a15d672eb tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:38.714419 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-16884637-1847-4e7d-918b-b82a15d672eb tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: f68f898c-130d-4eec-853c-db3269cb0fe4] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:38.722280 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-16884637-1847-4e7d-918b-b82a15d672eb tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:38.722865 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-16884637-1847-4e7d-918b-b82a15d672eb tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:38.723550 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-16884637-1847-4e7d-918b-b82a15d672eb tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:38.724499 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-16884637-1847-4e7d-918b-b82a15d672eb tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:38.724991 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-16884637-1847-4e7d-918b-b82a15d672eb tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:38.725451 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-16884637-1847-4e7d-918b-b82a15d672eb tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:38.789829 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-16884637-1847-4e7d-918b-b82a15d672eb tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:38.798512 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-16884637-1847-4e7d-918b-b82a15d672eb tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4" status: 200 len: 1277 microversion: 2.1 time: 0.090422 Sep 23 15:24:38.799093 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 263/547] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:38 2022] GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4 => generated 1277 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:39.471408 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-e8de8887-a7f8-4847-8605-242db194ff4a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:39.472142 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-e8de8887-a7f8-4847-8605-242db194ff4a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:39.478882 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e8de8887-a7f8-4847-8605-242db194ff4a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:39.479365 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e8de8887-a7f8-4847-8605-242db194ff4a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:39.479798 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e8de8887-a7f8-4847-8605-242db194ff4a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:39.480599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e8de8887-a7f8-4847-8605-242db194ff4a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:39.481056 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e8de8887-a7f8-4847-8605-242db194ff4a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:39.481483 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e8de8887-a7f8-4847-8605-242db194ff4a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:39.614230 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-e8de8887-a7f8-4847-8605-242db194ff4a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:39.624120 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-e8de8887-a7f8-4847-8605-242db194ff4a tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1725 microversion: 2.1 time: 0.156543 Sep 23 15:24:39.624704 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 285/548] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:39 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:39.829109 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-b85f91db-8461-4ef3-a34f-2f686277c8f9 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:39.829725 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-b85f91db-8461-4ef3-a34f-2f686277c8f9 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: f68f898c-130d-4eec-853c-db3269cb0fe4] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:39.836904 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b85f91db-8461-4ef3-a34f-2f686277c8f9 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:39.837641 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b85f91db-8461-4ef3-a34f-2f686277c8f9 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:39.838087 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b85f91db-8461-4ef3-a34f-2f686277c8f9 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:39.838790 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b85f91db-8461-4ef3-a34f-2f686277c8f9 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:39.839415 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b85f91db-8461-4ef3-a34f-2f686277c8f9 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:39.839841 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b85f91db-8461-4ef3-a34f-2f686277c8f9 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:40.068206 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b85f91db-8461-4ef3-a34f-2f686277c8f9 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:40.080384 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-b85f91db-8461-4ef3-a34f-2f686277c8f9 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4" status: 200 len: 1319 microversion: 2.1 time: 0.255360 Sep 23 15:24:40.097062 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 264/549] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:39 2022] GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4 => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:40.375851 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-8d5367f6-b75f-4f17-b29d-466b37eef835 req-2295768f-5df7-453d-97e2-184a7828c40f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14c2bdac-30a5-4a8a-ad91-191c529f77df", "tag": "f8bb92b2-35e5-484a-adc2-f6309c059f45"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:40.389350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-8d5367f6-b75f-4f17-b29d-466b37eef835 req-2295768f-5df7-453d-97e2-184a7828c40f service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:40.390390 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-8d5367f6-b75f-4f17-b29d-466b37eef835 req-2295768f-5df7-453d-97e2-184a7828c40f service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:40.391052 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-8d5367f6-b75f-4f17-b29d-466b37eef835 req-2295768f-5df7-453d-97e2-184a7828c40f service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:40.422309 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-8d5367f6-b75f-4f17-b29d-466b37eef835 req-2295768f-5df7-453d-97e2-184a7828c40f service nova] Creating event network-changed:f8bb92b2-35e5-484a-adc2-f6309c059f45 for instance 14c2bdac-30a5-4a8a-ad91-191c529f77df on hv-cinder-85530 Sep 23 15:24:40.428267 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-8d5367f6-b75f-4f17-b29d-466b37eef835 req-2295768f-5df7-453d-97e2-184a7828c40f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056974 Sep 23 15:24:40.429130 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 286/550] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:24:40.649506 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-5926e8d6-fa54-4bc6-a82d-f7e3eded1f98 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:40.650512 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-5926e8d6-fa54-4bc6-a82d-f7e3eded1f98 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:40.656713 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5926e8d6-fa54-4bc6-a82d-f7e3eded1f98 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:40.657335 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5926e8d6-fa54-4bc6-a82d-f7e3eded1f98 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:40.657816 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5926e8d6-fa54-4bc6-a82d-f7e3eded1f98 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:40.658642 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5926e8d6-fa54-4bc6-a82d-f7e3eded1f98 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:40.659166 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5926e8d6-fa54-4bc6-a82d-f7e3eded1f98 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:40.660079 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5926e8d6-fa54-4bc6-a82d-f7e3eded1f98 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:40.802296 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-5926e8d6-fa54-4bc6-a82d-f7e3eded1f98 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:40.812118 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-5926e8d6-fa54-4bc6-a82d-f7e3eded1f98 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1731 microversion: 2.1 time: 0.166808 Sep 23 15:24:40.816022 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 265/551] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:40 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:40.837233 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-6801cd4a-0e7d-4f71-afe5-7f21e3fcae7f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:40.837900 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-6801cd4a-0e7d-4f71-afe5-7f21e3fcae7f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:40.846064 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6801cd4a-0e7d-4f71-afe5-7f21e3fcae7f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:40.847331 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6801cd4a-0e7d-4f71-afe5-7f21e3fcae7f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:40.847852 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6801cd4a-0e7d-4f71-afe5-7f21e3fcae7f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:40.848670 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6801cd4a-0e7d-4f71-afe5-7f21e3fcae7f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:40.849190 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6801cd4a-0e7d-4f71-afe5-7f21e3fcae7f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:40.849683 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6801cd4a-0e7d-4f71-afe5-7f21e3fcae7f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:40.857783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-53b940d4-310a-4370-a71a-aa0eacc3e46d req-21f3c71d-25a3-4517-97b4-c7e838060bca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f68f898c-130d-4eec-853c-db3269cb0fe4", "tag": "792915ae-417d-47c8-9b7b-c0d355d202c7"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:40.876277 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-53b940d4-310a-4370-a71a-aa0eacc3e46d req-21f3c71d-25a3-4517-97b4-c7e838060bca service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:40.880407 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-53b940d4-310a-4370-a71a-aa0eacc3e46d req-21f3c71d-25a3-4517-97b4-c7e838060bca service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:40.880876 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-53b940d4-310a-4370-a71a-aa0eacc3e46d req-21f3c71d-25a3-4517-97b4-c7e838060bca service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:40.893727 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-53b940d4-310a-4370-a71a-aa0eacc3e46d req-21f3c71d-25a3-4517-97b4-c7e838060bca service nova] Creating event network-changed:792915ae-417d-47c8-9b7b-c0d355d202c7 for instance f68f898c-130d-4eec-853c-db3269cb0fe4 on hv-cinder-85530 Sep 23 15:24:40.900811 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-53b940d4-310a-4370-a71a-aa0eacc3e46d req-21f3c71d-25a3-4517-97b4-c7e838060bca service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047916 Sep 23 15:24:40.902023 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 266/552] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:24:41.046608 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-6801cd4a-0e7d-4f71-afe5-7f21e3fcae7f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.214537 Sep 23 15:24:41.048161 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 287/553] 10.222.0.55 () {58 vars in 1275 bytes} [Fri Sep 23 15:24:40 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/os-interface => generated 285 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:24:41.104077 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-dcadde9a-f90e-4935-8fcb-e2daf38ec344 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:41.105196 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-dcadde9a-f90e-4935-8fcb-e2daf38ec344 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: f68f898c-130d-4eec-853c-db3269cb0fe4] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:41.111859 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dcadde9a-f90e-4935-8fcb-e2daf38ec344 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:41.112508 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dcadde9a-f90e-4935-8fcb-e2daf38ec344 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:41.113015 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dcadde9a-f90e-4935-8fcb-e2daf38ec344 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:41.113785 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dcadde9a-f90e-4935-8fcb-e2daf38ec344 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:41.114307 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dcadde9a-f90e-4935-8fcb-e2daf38ec344 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:41.114801 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dcadde9a-f90e-4935-8fcb-e2daf38ec344 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:41.561219 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-dcadde9a-f90e-4935-8fcb-e2daf38ec344 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:41.573306 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-dcadde9a-f90e-4935-8fcb-e2daf38ec344 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4" status: 200 len: 1319 microversion: 2.1 time: 0.473279 Sep 23 15:24:41.574091 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 267/554] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:41 2022] GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4 => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:42.476578 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-ead17a49-f5e0-4fd6-8ded-e94a08a95b56 req-56ad06a7-714d-47b6-861a-8b47871e53a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d2de5a1-7ae9-4010-a7fc-5d2f45212418", "tag": "7d99929c-386a-4e5e-bc8f-6751a85b69b8"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:42.486957 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-ead17a49-f5e0-4fd6-8ded-e94a08a95b56 req-56ad06a7-714d-47b6-861a-8b47871e53a6 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:42.489385 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-ead17a49-f5e0-4fd6-8ded-e94a08a95b56 req-56ad06a7-714d-47b6-861a-8b47871e53a6 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:42.489385 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-ead17a49-f5e0-4fd6-8ded-e94a08a95b56 req-56ad06a7-714d-47b6-861a-8b47871e53a6 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:42.501007 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-ead17a49-f5e0-4fd6-8ded-e94a08a95b56 req-56ad06a7-714d-47b6-861a-8b47871e53a6 service nova] Creating event network-changed:7d99929c-386a-4e5e-bc8f-6751a85b69b8 for instance 7d2de5a1-7ae9-4010-a7fc-5d2f45212418 on hv-cinder-85530 Sep 23 15:24:42.506503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-ead17a49-f5e0-4fd6-8ded-e94a08a95b56 req-56ad06a7-714d-47b6-861a-8b47871e53a6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034372 Sep 23 15:24:42.507103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 288/555] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:24:42.596860 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-114a19e7-a547-40c8-a501-f2b60ff4673a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:42.597567 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-114a19e7-a547-40c8-a501-f2b60ff4673a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: f68f898c-130d-4eec-853c-db3269cb0fe4] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:42.600065 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_api:SELECT=80 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:42.606487 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-114a19e7-a547-40c8-a501-f2b60ff4673a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:42.607327 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-114a19e7-a547-40c8-a501-f2b60ff4673a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:42.608108 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-114a19e7-a547-40c8-a501-f2b60ff4673a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:42.608924 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-114a19e7-a547-40c8-a501-f2b60ff4673a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:42.609494 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-114a19e7-a547-40c8-a501-f2b60ff4673a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:42.610102 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-114a19e7-a547-40c8-a501-f2b60ff4673a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:42.750642 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-114a19e7-a547-40c8-a501-f2b60ff4673a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:42.758722 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-114a19e7-a547-40c8-a501-f2b60ff4673a tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4" status: 200 len: 1319 microversion: 2.1 time: 0.165959 Sep 23 15:24:42.759597 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 268/556] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:42 2022] GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:43.783987 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-e2e80245-87ed-46e7-8b55-0f2fc2160713 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:43.784701 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-e2e80245-87ed-46e7-8b55-0f2fc2160713 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: f68f898c-130d-4eec-853c-db3269cb0fe4] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:43.791349 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e2e80245-87ed-46e7-8b55-0f2fc2160713 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:43.791833 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e2e80245-87ed-46e7-8b55-0f2fc2160713 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:43.792295 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e2e80245-87ed-46e7-8b55-0f2fc2160713 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:43.792987 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e2e80245-87ed-46e7-8b55-0f2fc2160713 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:43.793453 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e2e80245-87ed-46e7-8b55-0f2fc2160713 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:43.793854 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e2e80245-87ed-46e7-8b55-0f2fc2160713 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:44.017460 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell0:SELECT=4 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:44.037467 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell0:SELECT=6 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:44.076132 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-340e7be0-03bc-4a85-b79c-e52353d397e3 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2069957819"}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:44.076988 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-340e7be0-03bc-4a85-b79c-e52353d397e3 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:44.084169 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-340e7be0-03bc-4a85-b79c-e52353d397e3 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:44.084668 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-340e7be0-03bc-4a85-b79c-e52353d397e3 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:44.085113 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-340e7be0-03bc-4a85-b79c-e52353d397e3 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:44.085821 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-340e7be0-03bc-4a85-b79c-e52353d397e3 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:44.086380 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-340e7be0-03bc-4a85-b79c-e52353d397e3 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:44.086859 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-340e7be0-03bc-4a85-b79c-e52353d397e3 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:44.221779 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.network.security_group_api [None req-340e7be0-03bc-4a85-b79c-e52353d397e3 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Adding security group 2737feda-37fe-49e8-9669-324943584fe5 to port f8bb92b2-35e5-484a-adc2-f6309c059f45 Sep 23 15:24:44.240543 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-e2e80245-87ed-46e7-8b55-0f2fc2160713 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:44.251063 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-e2e80245-87ed-46e7-8b55-0f2fc2160713 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4" status: 200 len: 1319 microversion: 2.1 time: 0.471471 Sep 23 15:24:44.253440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 289/557] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:43 2022] GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4 => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:44.296132 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell0:SELECT=2 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:44.522451 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-f0db279e-4381-4a75-a513-e236ffcbb052 req-31be90db-14e7-4898-978d-4b26edf1e785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d2de5a1-7ae9-4010-a7fc-5d2f45212418", "tag": "7d99929c-386a-4e5e-bc8f-6751a85b69b8"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:44.532584 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-f0db279e-4381-4a75-a513-e236ffcbb052 req-31be90db-14e7-4898-978d-4b26edf1e785 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:44.533058 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-f0db279e-4381-4a75-a513-e236ffcbb052 req-31be90db-14e7-4898-978d-4b26edf1e785 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:44.533491 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-f0db279e-4381-4a75-a513-e236ffcbb052 req-31be90db-14e7-4898-978d-4b26edf1e785 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:44.545841 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-f0db279e-4381-4a75-a513-e236ffcbb052 req-31be90db-14e7-4898-978d-4b26edf1e785 service nova] Creating event network-changed:7d99929c-386a-4e5e-bc8f-6751a85b69b8 for instance 7d2de5a1-7ae9-4010-a7fc-5d2f45212418 on hv-cinder-85530 Sep 23 15:24:44.551027 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-f0db279e-4381-4a75-a513-e236ffcbb052 req-31be90db-14e7-4898-978d-4b26edf1e785 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032654 Sep 23 15:24:44.551960 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 290/558] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:24:44.740215 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-340e7be0-03bc-4a85-b79c-e52353d397e3 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "POST /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df/action" status: 202 len: 0 microversion: 2.1 time: 0.668580 Sep 23 15:24:44.745184 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 269/559] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Sep 23 15:24:44 2022] POST /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df/action => generated 0 bytes in 675 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:24:44.751877 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-62eebb6d-a325-4387-b811-9405682b4c66 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:44.752680 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-62eebb6d-a325-4387-b811-9405682b4c66 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:44.759924 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-62eebb6d-a325-4387-b811-9405682b4c66 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:44.760446 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-62eebb6d-a325-4387-b811-9405682b4c66 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:44.761062 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-62eebb6d-a325-4387-b811-9405682b4c66 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:44.761941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-62eebb6d-a325-4387-b811-9405682b4c66 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:44.762657 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-62eebb6d-a325-4387-b811-9405682b4c66 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:44.763090 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-62eebb6d-a325-4387-b811-9405682b4c66 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:45.042685 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-62eebb6d-a325-4387-b811-9405682b4c66 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:45.051556 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-62eebb6d-a325-4387-b811-9405682b4c66 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1761 microversion: 2.1 time: 0.304124 Sep 23 15:24:45.052268 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 291/560] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:44 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1761 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:45.277575 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-133adac8-daa1-4c1b-8d1a-f995f0da413e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:45.278199 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-133adac8-daa1-4c1b-8d1a-f995f0da413e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: f68f898c-130d-4eec-853c-db3269cb0fe4] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:45.284447 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-133adac8-daa1-4c1b-8d1a-f995f0da413e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:45.285038 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-133adac8-daa1-4c1b-8d1a-f995f0da413e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:45.285596 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-133adac8-daa1-4c1b-8d1a-f995f0da413e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:45.286385 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-133adac8-daa1-4c1b-8d1a-f995f0da413e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:45.286915 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-133adac8-daa1-4c1b-8d1a-f995f0da413e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:45.287407 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-133adac8-daa1-4c1b-8d1a-f995f0da413e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:45.423601 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-133adac8-daa1-4c1b-8d1a-f995f0da413e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:45.432583 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-133adac8-daa1-4c1b-8d1a-f995f0da413e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4" status: 200 len: 1319 microversion: 2.1 time: 0.160417 Sep 23 15:24:45.433347 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 270/561] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:45 2022] GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:46.456592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-bb6483ed-1038-4ffa-9763-c7d5c89b2deb tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:46.457319 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-bb6483ed-1038-4ffa-9763-c7d5c89b2deb tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: f68f898c-130d-4eec-853c-db3269cb0fe4] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:46.464928 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bb6483ed-1038-4ffa-9763-c7d5c89b2deb tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:46.466839 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bb6483ed-1038-4ffa-9763-c7d5c89b2deb tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:46.466839 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bb6483ed-1038-4ffa-9763-c7d5c89b2deb tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:46.466839 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bb6483ed-1038-4ffa-9763-c7d5c89b2deb tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:46.467163 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bb6483ed-1038-4ffa-9763-c7d5c89b2deb tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:46.467598 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bb6483ed-1038-4ffa-9763-c7d5c89b2deb tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:46.487091 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:46.565559 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-e01c47f4-3828-4f9e-999c-9c302617ec1d req-e40395a8-2a75-4689-a86b-13717647961d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14c2bdac-30a5-4a8a-ad91-191c529f77df", "tag": "f8bb92b2-35e5-484a-adc2-f6309c059f45"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:46.576577 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-e01c47f4-3828-4f9e-999c-9c302617ec1d req-e40395a8-2a75-4689-a86b-13717647961d service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:46.583675 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-e01c47f4-3828-4f9e-999c-9c302617ec1d req-e40395a8-2a75-4689-a86b-13717647961d service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:46.583675 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-e01c47f4-3828-4f9e-999c-9c302617ec1d req-e40395a8-2a75-4689-a86b-13717647961d service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:46.591335 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-e01c47f4-3828-4f9e-999c-9c302617ec1d req-e40395a8-2a75-4689-a86b-13717647961d service nova] Creating event network-changed:f8bb92b2-35e5-484a-adc2-f6309c059f45 for instance 14c2bdac-30a5-4a8a-ad91-191c529f77df on hv-cinder-85530 Sep 23 15:24:46.597249 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-e01c47f4-3828-4f9e-999c-9c302617ec1d req-e40395a8-2a75-4689-a86b-13717647961d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034926 Sep 23 15:24:46.597889 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 271/562] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:24:46.610188 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-bb6483ed-1038-4ffa-9763-c7d5c89b2deb tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:46.617628 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-bb6483ed-1038-4ffa-9763-c7d5c89b2deb tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4" status: 200 len: 1319 microversion: 2.1 time: 0.165485 Sep 23 15:24:46.619536 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 292/563] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:46 2022] GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:47.557921 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-71b18d18-22b8-47f4-a29b-9426221a878b req-adda286e-e88f-44f5-86e5-c10502623fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f68f898c-130d-4eec-853c-db3269cb0fe4", "name": "network-vif-plugged", "status": "completed", "tag": "792915ae-417d-47c8-9b7b-c0d355d202c7"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:47.567842 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-71b18d18-22b8-47f4-a29b-9426221a878b req-adda286e-e88f-44f5-86e5-c10502623fe2 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:47.568470 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-71b18d18-22b8-47f4-a29b-9426221a878b req-adda286e-e88f-44f5-86e5-c10502623fe2 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:47.568701 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-71b18d18-22b8-47f4-a29b-9426221a878b req-adda286e-e88f-44f5-86e5-c10502623fe2 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:47.580089 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-71b18d18-22b8-47f4-a29b-9426221a878b req-adda286e-e88f-44f5-86e5-c10502623fe2 service nova] Creating event network-vif-plugged:792915ae-417d-47c8-9b7b-c0d355d202c7 for instance f68f898c-130d-4eec-853c-db3269cb0fe4 on hv-cinder-85530 Sep 23 15:24:47.588489 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-71b18d18-22b8-47f4-a29b-9426221a878b req-adda286e-e88f-44f5-86e5-c10502623fe2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031590 Sep 23 15:24:47.588489 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 272/564] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:24:47.641915 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-daedd089-574d-4edd-8def-408a65aa2944 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:47.642500 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-daedd089-574d-4edd-8def-408a65aa2944 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: f68f898c-130d-4eec-853c-db3269cb0fe4] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:47.649807 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-daedd089-574d-4edd-8def-408a65aa2944 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:47.652708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-daedd089-574d-4edd-8def-408a65aa2944 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:47.652708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-daedd089-574d-4edd-8def-408a65aa2944 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:47.652708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-daedd089-574d-4edd-8def-408a65aa2944 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:47.652708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-daedd089-574d-4edd-8def-408a65aa2944 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:47.653100 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-daedd089-574d-4edd-8def-408a65aa2944 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:47.788234 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-daedd089-574d-4edd-8def-408a65aa2944 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:47.797036 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-daedd089-574d-4edd-8def-408a65aa2944 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4" status: 200 len: 1319 microversion: 2.1 time: 0.159265 Sep 23 15:24:47.797609 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 293/565] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:47 2022] GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:48.820381 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-b80079c8-d26c-43f0-85a5-7a39f7dcbb37 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:48.821470 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-b80079c8-d26c-43f0-85a5-7a39f7dcbb37 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: f68f898c-130d-4eec-853c-db3269cb0fe4] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:48.827246 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b80079c8-d26c-43f0-85a5-7a39f7dcbb37 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:48.827729 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b80079c8-d26c-43f0-85a5-7a39f7dcbb37 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:48.828208 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b80079c8-d26c-43f0-85a5-7a39f7dcbb37 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:48.828904 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b80079c8-d26c-43f0-85a5-7a39f7dcbb37 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:48.829357 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b80079c8-d26c-43f0-85a5-7a39f7dcbb37 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:48.829801 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b80079c8-d26c-43f0-85a5-7a39f7dcbb37 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:48.965793 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b80079c8-d26c-43f0-85a5-7a39f7dcbb37 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:48.968971 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-b80079c8-d26c-43f0-85a5-7a39f7dcbb37 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4" status: 200 len: 1319 microversion: 2.1 time: 0.153374 Sep 23 15:24:48.969552 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 273/566] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:48 2022] GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:49.991756 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-c38227cb-a983-43e2-b274-064efc3c208c tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:49.992391 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-c38227cb-a983-43e2-b274-064efc3c208c tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: f68f898c-130d-4eec-853c-db3269cb0fe4] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:49.999026 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c38227cb-a983-43e2-b274-064efc3c208c tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:49.999504 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c38227cb-a983-43e2-b274-064efc3c208c tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:49.999937 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c38227cb-a983-43e2-b274-064efc3c208c tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:50.000644 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c38227cb-a983-43e2-b274-064efc3c208c tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:50.001100 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c38227cb-a983-43e2-b274-064efc3c208c tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:50.001791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c38227cb-a983-43e2-b274-064efc3c208c tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:50.138066 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-c38227cb-a983-43e2-b274-064efc3c208c tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:50.145936 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-c38227cb-a983-43e2-b274-064efc3c208c tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4" status: 200 len: 1319 microversion: 2.1 time: 0.158077 Sep 23 15:24:50.146517 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 294/567] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:49 2022] GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:51.169342 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-5d72d3af-e9b7-44a5-86c4-9d4614caefb5 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:51.169965 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-5d72d3af-e9b7-44a5-86c4-9d4614caefb5 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: f68f898c-130d-4eec-853c-db3269cb0fe4] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:51.176592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5d72d3af-e9b7-44a5-86c4-9d4614caefb5 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:51.177079 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5d72d3af-e9b7-44a5-86c4-9d4614caefb5 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:51.177522 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5d72d3af-e9b7-44a5-86c4-9d4614caefb5 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:51.178211 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5d72d3af-e9b7-44a5-86c4-9d4614caefb5 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:51.178672 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5d72d3af-e9b7-44a5-86c4-9d4614caefb5 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:51.179101 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5d72d3af-e9b7-44a5-86c4-9d4614caefb5 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:51.315938 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-5d72d3af-e9b7-44a5-86c4-9d4614caefb5 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:51.324713 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-5d72d3af-e9b7-44a5-86c4-9d4614caefb5 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4" status: 200 len: 1509 microversion: 2.1 time: 0.159915 Sep 23 15:24:51.325327 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 274/568] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:51 2022] GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:51.348076 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-5d419e92-7bab-40cf-bd86-8527bc81ce8e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6bf8c17f-c2aa-47d2-8c05-dd1048f71507", "device": "/dev/sdb"}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:51.350897 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-5d419e92-7bab-40cf-bd86-8527bc81ce8e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: f68f898c-130d-4eec-853c-db3269cb0fe4] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:51.357270 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5d419e92-7bab-40cf-bd86-8527bc81ce8e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:51.357764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5d419e92-7bab-40cf-bd86-8527bc81ce8e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:51.358241 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5d419e92-7bab-40cf-bd86-8527bc81ce8e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:51.358930 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5d419e92-7bab-40cf-bd86-8527bc81ce8e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:51.359358 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5d419e92-7bab-40cf-bd86-8527bc81ce8e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:51.359770 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5d419e92-7bab-40cf-bd86-8527bc81ce8e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:51.543497 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-82d572f5-1798-4c05-99f7-fac3d4c0a172 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:51.544016 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-82d572f5-1798-4c05-99f7-fac3d4c0a172 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:51.549831 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-82d572f5-1798-4c05-99f7-fac3d4c0a172 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:51.550366 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-82d572f5-1798-4c05-99f7-fac3d4c0a172 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:51.550802 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-82d572f5-1798-4c05-99f7-fac3d4c0a172 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:51.551484 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-82d572f5-1798-4c05-99f7-fac3d4c0a172 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:51.551947 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-82d572f5-1798-4c05-99f7-fac3d4c0a172 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:51.552444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-82d572f5-1798-4c05-99f7-fac3d4c0a172 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:51.584775 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-82d572f5-1798-4c05-99f7-fac3d4c0a172 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca/os-volume_attachments/9cb37291-1e02-43f5-8b81-d8b30293af64" status: 200 len: 194 microversion: 2.20 time: 0.045316 Sep 23 15:24:51.585378 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 275/569] 10.222.0.55 () {60 vars in 1454 bytes} [Fri Sep 23 15:24:51 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca/os-volume_attachments/9cb37291-1e02-43f5-8b81-d8b30293af64 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 15:24:51.657155 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-13032b24-fb15-4606-8e41-a78a67e5b023 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:51.657645 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-13032b24-fb15-4606-8e41-a78a67e5b023 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:51.663914 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-13032b24-fb15-4606-8e41-a78a67e5b023 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:51.664495 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-13032b24-fb15-4606-8e41-a78a67e5b023 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:51.664921 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-13032b24-fb15-4606-8e41-a78a67e5b023 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:51.665728 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-13032b24-fb15-4606-8e41-a78a67e5b023 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:51.666179 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-13032b24-fb15-4606-8e41-a78a67e5b023 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:51.666601 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-13032b24-fb15-4606-8e41-a78a67e5b023 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:51.748764 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.objects.instance [None req-13032b24-fb15-4606-8e41-a78a67e5b023 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lazy-loading 'services' on Instance uuid 4bba6fdd-bec4-491e-81ba-f3a9863f72ca {{(pid=121448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:24:51.999106 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-13032b24-fb15-4606-8e41-a78a67e5b023 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "DELETE /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca/os-volume_attachments/9cb37291-1e02-43f5-8b81-d8b30293af64" status: 202 len: 0 microversion: 2.20 time: 0.345480 Sep 23 15:24:52.009189 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 276/570] 10.222.0.55 () {60 vars in 1457 bytes} [Fri Sep 23 15:24:51 2022] DELETE /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca/os-volume_attachments/9cb37291-1e02-43f5-8b81-d8b30293af64 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 23 15:24:52.010548 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-57f0b39d-8bc0-4dea-b6f9-72adfbbb8fa7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:52.013407 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-57f0b39d-8bc0-4dea-b6f9-72adfbbb8fa7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:52.019779 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-57f0b39d-8bc0-4dea-b6f9-72adfbbb8fa7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:52.020308 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-57f0b39d-8bc0-4dea-b6f9-72adfbbb8fa7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:52.020742 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-57f0b39d-8bc0-4dea-b6f9-72adfbbb8fa7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:52.021440 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-57f0b39d-8bc0-4dea-b6f9-72adfbbb8fa7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:52.021892 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-57f0b39d-8bc0-4dea-b6f9-72adfbbb8fa7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:52.022320 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-57f0b39d-8bc0-4dea-b6f9-72adfbbb8fa7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:52.054876 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-57f0b39d-8bc0-4dea-b6f9-72adfbbb8fa7 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049136 Sep 23 15:24:52.055973 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 277/571] 10.222.0.55 () {60 vars in 1343 bytes} [Fri Sep 23 15:24:52 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:24:52.189133 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-5d419e92-7bab-40cf-bd86-8527bc81ce8e tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "POST /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.844778 Sep 23 15:24:52.189749 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 295/572] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Sep 23 15:24:51 2022] POST /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4/os-volume_attachments => generated 194 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:24:53.068238 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a3b56e36-22fe-4937-b49b-93f5ddf695bf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:53.070472 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-a3b56e36-22fe-4937-b49b-93f5ddf695bf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:53.077168 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a3b56e36-22fe-4937-b49b-93f5ddf695bf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:53.077990 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a3b56e36-22fe-4937-b49b-93f5ddf695bf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:53.078438 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a3b56e36-22fe-4937-b49b-93f5ddf695bf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:53.079150 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a3b56e36-22fe-4937-b49b-93f5ddf695bf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:53.079606 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a3b56e36-22fe-4937-b49b-93f5ddf695bf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:53.080199 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a3b56e36-22fe-4937-b49b-93f5ddf695bf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:53.111862 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-a3b56e36-22fe-4937-b49b-93f5ddf695bf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047648 Sep 23 15:24:53.112490 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 278/573] 10.222.0.55 () {60 vars in 1343 bytes} [Fri Sep 23 15:24:53 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:24:54.125584 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-315fe016-8383-40d6-9571-427cf7d86dd8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:54.128983 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-315fe016-8383-40d6-9571-427cf7d86dd8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:54.137931 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-315fe016-8383-40d6-9571-427cf7d86dd8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:54.138414 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-315fe016-8383-40d6-9571-427cf7d86dd8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:54.138843 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-315fe016-8383-40d6-9571-427cf7d86dd8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:54.139524 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-315fe016-8383-40d6-9571-427cf7d86dd8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:54.139966 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-315fe016-8383-40d6-9571-427cf7d86dd8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:54.140415 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-315fe016-8383-40d6-9571-427cf7d86dd8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:54.173950 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-315fe016-8383-40d6-9571-427cf7d86dd8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052654 Sep 23 15:24:54.177956 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 296/574] 10.222.0.55 () {60 vars in 1343 bytes} [Fri Sep 23 15:24:54 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:54.241152 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-39022611-bae3-4b65-a9d7-e551ff4bed72 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:54.241696 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-39022611-bae3-4b65-a9d7-e551ff4bed72 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:54.249338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-39022611-bae3-4b65-a9d7-e551ff4bed72 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:54.249828 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-39022611-bae3-4b65-a9d7-e551ff4bed72 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:54.250602 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-39022611-bae3-4b65-a9d7-e551ff4bed72 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:54.251634 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-39022611-bae3-4b65-a9d7-e551ff4bed72 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:54.252129 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-39022611-bae3-4b65-a9d7-e551ff4bed72 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:54.252557 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-39022611-bae3-4b65-a9d7-e551ff4bed72 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:54.256745 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:54.280216 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-39022611-bae3-4b65-a9d7-e551ff4bed72 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Going to try to terminate instance {{(pid=121448) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:24:54.636545 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-39022611-bae3-4b65-a9d7-e551ff4bed72 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "DELETE /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 204 len: 0 microversion: 2.20 time: 0.398899 Sep 23 15:24:54.637177 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 279/575] 10.222.0.55 () {60 vars in 1280 bytes} [Fri Sep 23 15:24:54 2022] DELETE /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 15:24:54.645669 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-d3e53dbc-0dbc-421f-9fd1-9f9893a67313 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:54.646326 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-d3e53dbc-0dbc-421f-9fd1-9f9893a67313 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:54.653641 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d3e53dbc-0dbc-421f-9fd1-9f9893a67313 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:54.653929 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d3e53dbc-0dbc-421f-9fd1-9f9893a67313 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:54.654362 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d3e53dbc-0dbc-421f-9fd1-9f9893a67313 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:54.655060 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d3e53dbc-0dbc-421f-9fd1-9f9893a67313 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:54.655571 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d3e53dbc-0dbc-421f-9fd1-9f9893a67313 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:54.656015 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d3e53dbc-0dbc-421f-9fd1-9f9893a67313 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:54.800083 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-d3e53dbc-0dbc-421f-9fd1-9f9893a67313 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:54.809613 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-d3e53dbc-0dbc-421f-9fd1-9f9893a67313 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:54.811044 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-d3e53dbc-0dbc-421f-9fd1-9f9893a67313 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:54.812223 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-d3e53dbc-0dbc-421f-9fd1-9f9893a67313 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1724 microversion: 2.20 time: 0.170490 Sep 23 15:24:54.812782 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 297/576] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:24:54 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:24:55.838773 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-f863d187-231c-44fd-b8b6-aa02ded89c9e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:55.839501 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-f863d187-231c-44fd-b8b6-aa02ded89c9e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:55.846111 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f863d187-231c-44fd-b8b6-aa02ded89c9e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:55.846598 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f863d187-231c-44fd-b8b6-aa02ded89c9e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:55.847039 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f863d187-231c-44fd-b8b6-aa02ded89c9e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:55.847727 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f863d187-231c-44fd-b8b6-aa02ded89c9e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:55.848283 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f863d187-231c-44fd-b8b6-aa02ded89c9e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:55.848715 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f863d187-231c-44fd-b8b6-aa02ded89c9e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:55.979544 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-f863d187-231c-44fd-b8b6-aa02ded89c9e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:55.987693 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-f863d187-231c-44fd-b8b6-aa02ded89c9e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:55.989522 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-f863d187-231c-44fd-b8b6-aa02ded89c9e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:55.991047 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-f863d187-231c-44fd-b8b6-aa02ded89c9e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1724 microversion: 2.20 time: 0.157140 Sep 23 15:24:55.991737 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 280/577] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:24:55 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:24:57.018848 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-70dc40c7-048b-4311-914d-f6acd3ce8354 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:57.019512 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-70dc40c7-048b-4311-914d-f6acd3ce8354 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:57.026778 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-70dc40c7-048b-4311-914d-f6acd3ce8354 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:57.027258 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-70dc40c7-048b-4311-914d-f6acd3ce8354 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:57.027695 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-70dc40c7-048b-4311-914d-f6acd3ce8354 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:57.028422 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-70dc40c7-048b-4311-914d-f6acd3ce8354 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:57.028875 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-70dc40c7-048b-4311-914d-f6acd3ce8354 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:57.029288 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-70dc40c7-048b-4311-914d-f6acd3ce8354 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:57.286239 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-70dc40c7-048b-4311-914d-f6acd3ce8354 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:57.296554 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-70dc40c7-048b-4311-914d-f6acd3ce8354 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:57.298051 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-70dc40c7-048b-4311-914d-f6acd3ce8354 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:57.299228 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-70dc40c7-048b-4311-914d-f6acd3ce8354 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1724 microversion: 2.20 time: 0.284365 Sep 23 15:24:57.299784 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 298/578] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:24:57 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:24:57.786651 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-84b51247-7087-4877-83a8-1d8a394d3d33 req-3030b389-005e-4816-be9e-4c85ae28e12e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bba6fdd-bec4-491e-81ba-f3a9863f72ca", "name": "network-vif-deleted", "tag": "8801bad0-f531-42e9-8015-b0d63a8e4f8e"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:57.798911 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-84b51247-7087-4877-83a8-1d8a394d3d33 req-3030b389-005e-4816-be9e-4c85ae28e12e service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:57.803790 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-84b51247-7087-4877-83a8-1d8a394d3d33 req-3030b389-005e-4816-be9e-4c85ae28e12e service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:57.803790 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-84b51247-7087-4877-83a8-1d8a394d3d33 req-3030b389-005e-4816-be9e-4c85ae28e12e service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:57.813751 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-84b51247-7087-4877-83a8-1d8a394d3d33 req-3030b389-005e-4816-be9e-4c85ae28e12e service nova] Creating event network-vif-deleted:8801bad0-f531-42e9-8015-b0d63a8e4f8e for instance 4bba6fdd-bec4-491e-81ba-f3a9863f72ca on hv-cinder-85530 Sep 23 15:24:57.820293 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-84b51247-7087-4877-83a8-1d8a394d3d33 req-3030b389-005e-4816-be9e-4c85ae28e12e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037234 Sep 23 15:24:57.821082 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 281/579] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:24:58.327433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-d8a39919-c0e8-4f24-ac09-0afe58cfddc6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:58.328491 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-d8a39919-c0e8-4f24-ac09-0afe58cfddc6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:58.340078 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d8a39919-c0e8-4f24-ac09-0afe58cfddc6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:58.340956 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d8a39919-c0e8-4f24-ac09-0afe58cfddc6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:58.341746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d8a39919-c0e8-4f24-ac09-0afe58cfddc6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:58.342877 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d8a39919-c0e8-4f24-ac09-0afe58cfddc6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:58.343715 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d8a39919-c0e8-4f24-ac09-0afe58cfddc6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:58.344503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d8a39919-c0e8-4f24-ac09-0afe58cfddc6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:58.401512 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d8a39919-c0e8-4f24-ac09-0afe58cfddc6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:58.402322 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d8a39919-c0e8-4f24-ac09-0afe58cfddc6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:58.403069 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d8a39919-c0e8-4f24-ac09-0afe58cfddc6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:58.403852 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.objects.instance [None req-d8a39919-c0e8-4f24-ac09-0afe58cfddc6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lazy-loading 'fault' on Instance uuid 4bba6fdd-bec4-491e-81ba-f3a9863f72ca {{(pid=121450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:24:58.451718 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-d8a39919-c0e8-4f24-ac09-0afe58cfddc6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:58.460707 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-d8a39919-c0e8-4f24-ac09-0afe58cfddc6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:58.462781 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-d8a39919-c0e8-4f24-ac09-0afe58cfddc6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:58.463950 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-d8a39919-c0e8-4f24-ac09-0afe58cfddc6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1372 microversion: 2.20 time: 0.140971 Sep 23 15:24:58.464531 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 299/580] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:24:58 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1372 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:24:59.491520 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6bb19a1f-0eaa-45d3-98e5-430e6a35e532 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:59.492402 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-6bb19a1f-0eaa-45d3-98e5-430e6a35e532 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:59.499814 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6bb19a1f-0eaa-45d3-98e5-430e6a35e532 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:59.500359 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6bb19a1f-0eaa-45d3-98e5-430e6a35e532 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:59.500798 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6bb19a1f-0eaa-45d3-98e5-430e6a35e532 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:59.501778 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6bb19a1f-0eaa-45d3-98e5-430e6a35e532 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:59.502310 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6bb19a1f-0eaa-45d3-98e5-430e6a35e532 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:59.502734 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6bb19a1f-0eaa-45d3-98e5-430e6a35e532 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:59.534743 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6bb19a1f-0eaa-45d3-98e5-430e6a35e532 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:59.535227 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6bb19a1f-0eaa-45d3-98e5-430e6a35e532 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:59.535668 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6bb19a1f-0eaa-45d3-98e5-430e6a35e532 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:59.536152 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.objects.instance [None req-6bb19a1f-0eaa-45d3-98e5-430e6a35e532 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lazy-loading 'fault' on Instance uuid 4bba6fdd-bec4-491e-81ba-f3a9863f72ca {{(pid=121448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:24:59.719544 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6bb19a1f-0eaa-45d3-98e5-430e6a35e532 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:59.728577 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6bb19a1f-0eaa-45d3-98e5-430e6a35e532 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:59.730071 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6bb19a1f-0eaa-45d3-98e5-430e6a35e532 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:59.731280 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-6bb19a1f-0eaa-45d3-98e5-430e6a35e532 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 200 len: 1372 microversion: 2.20 time: 0.244642 Sep 23 15:24:59.731845 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 282/581] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:24:59 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 1372 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:25:00.766246 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-434d9bc5-7ece-4ee3-a331-7206058192c1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:00.766864 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-434d9bc5-7ece-4ee3-a331-7206058192c1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:00.773969 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-434d9bc5-7ece-4ee3-a331-7206058192c1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:00.774684 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-434d9bc5-7ece-4ee3-a331-7206058192c1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:00.775800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-434d9bc5-7ece-4ee3-a331-7206058192c1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:00.775800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-434d9bc5-7ece-4ee3-a331-7206058192c1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:00.776348 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-434d9bc5-7ece-4ee3-a331-7206058192c1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:00.776768 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-434d9bc5-7ece-4ee3-a331-7206058192c1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:00.790675 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-434d9bc5-7ece-4ee3-a331-7206058192c1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] HTTP exception thrown: Instance 4bba6fdd-bec4-491e-81ba-f3a9863f72ca could not be found. Sep 23 15:25:00.792503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-434d9bc5-7ece-4ee3-a331-7206058192c1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Request method failure captured: Sep 23 15:25:00.792503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca HTTP/1.1 Sep 23 15:25:00.792503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:25:00.792503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:25:00.792503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:25:00.792503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:25:00.792503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:25:00.792503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:25:00.792503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:25:00.792503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:25:00.792503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLc6z5kX1NEdHC6q7BE3PXHLC5hIbEvdxDuXJ-X67qALlq5AFtNCX-mZWdpg8QXGj5SSi_JNV7yaeFmAAigIOxU2VVo0zoWq9DJ2abmiYqd5JEynIIq4T4UokqINUY0YwH-DT_W-iv8-833WO-050zX4ajLVUGKHy5mpN7dgy9E-DAaY Sep 23 15:25:00.792503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:25:00.792503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:25:00.792503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:25:00.792503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:25:00.792503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 15:25:00.792503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:25:00.792503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:25:00.792503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: 1679242155f94d48871525425f74d1c3 Sep 23 15:25:00.792503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-731499941 Sep 23 15:25:00.792503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:25:00.792503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:25:00.795351 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1679242155f94d48871525425f74d1c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1679242155f94d48871525425f74d1c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1679242155f94d48871525425f74d1c3", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1679242155f94d48871525425f74d1c3"}]}] Sep 23 15:25:00.795351 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-AttachVolumeShelveTestJSON-731499941 Sep 23 15:25:00.795351 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: 1679242155f94d48871525425f74d1c3 Sep 23 15:25:00.795351 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-731499941 Sep 23 15:25:00.795351 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-AttachVolumeShelveTestJSON-731499941-project Sep 23 15:25:00.795351 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:25:00.795351 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:25:00.795351 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 42dc378333ae4bbdbd42ce041ba15d3f Sep 23 15:25:00.795351 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-AttachVolumeShelveTestJSON-731499941-project Sep 23 15:25:00.795351 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:25:00.795351 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance 4bba6fdd-bec4-491e-81ba-f3a9863f72ca could not be found. Sep 23 15:25:00.795351 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '4bba6fdd-bec4-491e-81ba-f3a9863f72ca'} Sep 23 15:25:00.796655 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:25:00.796655 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:25:00.796655 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:25:00.796655 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:25:00.796655 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:25:00.796655 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:25:00.796655 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:25:00.796655 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:25:00.796655 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:25:00.796655 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:25:00.796655 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bba6fdd-bec4-491e-81ba-f3a9863f72ca could not be found. Sep 23 15:25:00.796655 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:25:00.796655 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:25:00.796655 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:25:00.796655 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:25:00.796655 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:25:00.796655 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:25:00.796655 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:25:00.796655 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:25:00.796655 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:25:00.798432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:25:00.798432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:25:00.798432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:25:00.798432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:25:00.798432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:25:00.798432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:25:00.798432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:25:00.798432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bba6fdd-bec4-491e-81ba-f3a9863f72ca could not be found. Sep 23 15:25:00.798432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:25:00.798432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:25:00.798432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:25:00.798432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:25:00.798432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:25:00.798432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:25:00.798432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:25:00.798432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:25:00.798432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bba6fdd-bec4-491e-81ba-f3a9863f72ca could not be found. Sep 23 15:25:00.798432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:25:00.799687 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-434d9bc5-7ece-4ee3-a331-7206058192c1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Returning 404 to user: Instance 4bba6fdd-bec4-491e-81ba-f3a9863f72ca could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:25:00.799687 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-434d9bc5-7ece-4ee3-a331-7206058192c1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 404 len: 111 microversion: 2.20 time: 0.032330 Sep 23 15:25:00.799687 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 300/582] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:00 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 15:25:00.803753 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-27153322-314d-4f60-99bc-ded82c09deb8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '.version_select at 0x7f82dbba70d0>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:00.894518 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-27153322-314d-4f60-99bc-ded82c09deb8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2038150903" status: 204 len: 0 microversion: 2.20 time: 0.094561 Sep 23 15:25:00.895192 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 283/583] 10.222.0.55 () {60 vars in 1262 bytes} [Fri Sep 23 15:25:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2038150903 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 15:25:01.785664 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-256cef29-f4e2-4fee-8965-ec2ea6519852 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Action: 'create', calling method: .version_select at 0x7f82dbb63c10>, body: {"keypair": {"name": "tempest-keypair-884697376", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlco7wZ5hdMZ35G+PanXJCbspn19q/caa+u2RvOLbEsWYGSX92QWE4aIGOfnQCn4kzET+HeXydJEsXifeY2QI71sy5sGUHwG3gjcSv3r/KhA5ICZPni0c1X3PJ9dDpd8w=="}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:25:01.803221 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:01.819531 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-256cef29-f4e2-4fee-8965-ec2ea6519852 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Getting quotas for project 1679242155f94d48871525425f74d1c3. Resources: {'key_pairs'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:25:01.825680 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-256cef29-f4e2-4fee-8965-ec2ea6519852 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Getting quotas for user 42dc378333ae4bbdbd42ce041ba15d3f and project 1679242155f94d48871525425f74d1c3. Resources: {'key_pairs'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:25:01.965172 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-256cef29-f4e2-4fee-8965-ec2ea6519852 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.176618 Sep 23 15:25:01.965172 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 301/584] 10.222.0.55 () {62 vars in 1200 bytes} [Fri Sep 23 15:25:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 178 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 23 15:25:04.920650 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-97a2a60b-58be-4e36-a096-87bc3db5b652 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-266782775", "imageRef": "051c4746-7f50-4edb-b09d-a8935df360de", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9884c67-117e-4e2a-8424-37edb233007d"}], "security_groups": [{"name": "tempest-securitygroup--1280041931"}], "key_name": "tempest-keypair-884697376", "user_data": "}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:25:05.031674 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.network.neutron [None req-97a2a60b-58be-4e36-a096-87bc3db5b652 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] validate_networks() for [('b9884c67-117e-4e2a-8424-37edb233007d', None, None, None, None, None)] {{(pid=121448) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:25:05.421094 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-97a2a60b-58be-4e36-a096-87bc3db5b652 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Flavor limits 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:25:05.426538 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-97a2a60b-58be-4e36-a096-87bc3db5b652 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Image limits 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:25:05.426538 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-97a2a60b-58be-4e36-a096-87bc3db5b652 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Flavor pref 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:25:05.426538 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-97a2a60b-58be-4e36-a096-87bc3db5b652 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Image pref 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:25:05.426538 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-97a2a60b-58be-4e36-a096-87bc3db5b652 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:25:05.433320 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-97a2a60b-58be-4e36-a096-87bc3db5b652 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:05.433957 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-97a2a60b-58be-4e36-a096-87bc3db5b652 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:05.434404 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-97a2a60b-58be-4e36-a096-87bc3db5b652 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:05.435143 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-97a2a60b-58be-4e36-a096-87bc3db5b652 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:05.435608 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-97a2a60b-58be-4e36-a096-87bc3db5b652 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:05.436062 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-97a2a60b-58be-4e36-a096-87bc3db5b652 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:05.454124 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-97a2a60b-58be-4e36-a096-87bc3db5b652 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Getting quotas for project 1679242155f94d48871525425f74d1c3. Resources: {'ram', 'instances', 'cores'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:25:05.458212 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-97a2a60b-58be-4e36-a096-87bc3db5b652 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Getting quotas for user 42dc378333ae4bbdbd42ce041ba15d3f and project 1679242155f94d48871525425f74d1c3. Resources: {'ram', 'instances', 'cores'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:25:05.470496 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-97a2a60b-58be-4e36-a096-87bc3db5b652 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Going to run 1 instances... {{(pid=121448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:25:05.472871 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-97a2a60b-58be-4e36-a096-87bc3db5b652 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='051c4746-7f50-4edb-b09d-a8935df360de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:25:05.823325 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-97a2a60b-58be-4e36-a096-87bc3db5b652 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.908145 Sep 23 15:25:05.823983 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 284/585] 10.222.0.55 () {62 vars in 1188 bytes} [Fri Sep 23 15:25:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 15:25:05.836699 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-801e117a-72a8-49ae-a101-2e17c1a6a5f9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:05.837348 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-801e117a-72a8-49ae-a101-2e17c1a6a5f9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:05.964001 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-801e117a-72a8-49ae-a101-2e17c1a6a5f9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:05.972277 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-801e117a-72a8-49ae-a101-2e17c1a6a5f9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:05.974231 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-801e117a-72a8-49ae-a101-2e17c1a6a5f9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:05.975682 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-801e117a-72a8-49ae-a101-2e17c1a6a5f9 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1280 microversion: 2.20 time: 0.144244 Sep 23 15:25:05.977099 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 302/586] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:05 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1280 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:25:07.004393 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-d3cc650a-9c0a-4a54-af8d-90b7f0a12949 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:07.005264 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-d3cc650a-9c0a-4a54-af8d-90b7f0a12949 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:07.013795 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d3cc650a-9c0a-4a54-af8d-90b7f0a12949 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:07.014605 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d3cc650a-9c0a-4a54-af8d-90b7f0a12949 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:07.014785 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d3cc650a-9c0a-4a54-af8d-90b7f0a12949 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:07.015898 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d3cc650a-9c0a-4a54-af8d-90b7f0a12949 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:07.016407 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d3cc650a-9c0a-4a54-af8d-90b7f0a12949 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:07.018024 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d3cc650a-9c0a-4a54-af8d-90b7f0a12949 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:07.091031 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-d3cc650a-9c0a-4a54-af8d-90b7f0a12949 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:07.099440 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-d3cc650a-9c0a-4a54-af8d-90b7f0a12949 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:07.100928 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-d3cc650a-9c0a-4a54-af8d-90b7f0a12949 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:07.102476 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-d3cc650a-9c0a-4a54-af8d-90b7f0a12949 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1284 microversion: 2.20 time: 0.102207 Sep 23 15:25:07.103042 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 285/587] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:06 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:25:07.684553 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-52ad1279-fed4-4e3c-ba5e-ea473ead3d8a tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:25:07.686680 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-52ad1279-fed4-4e3c-ba5e-ea473ead3d8a tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:07.694941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-52ad1279-fed4-4e3c-ba5e-ea473ead3d8a tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:07.695628 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-52ad1279-fed4-4e3c-ba5e-ea473ead3d8a tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:07.696222 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-52ad1279-fed4-4e3c-ba5e-ea473ead3d8a tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:07.697067 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-52ad1279-fed4-4e3c-ba5e-ea473ead3d8a tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:07.697515 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-52ad1279-fed4-4e3c-ba5e-ea473ead3d8a tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:07.697934 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-52ad1279-fed4-4e3c-ba5e-ea473ead3d8a tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:07.895523 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-52ad1279-fed4-4e3c-ba5e-ea473ead3d8a tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "POST /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df/action" status: 202 len: 0 microversion: 2.1 time: 0.214711 Sep 23 15:25:07.896443 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 303/588] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Sep 23 15:25:07 2022] POST /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:25:07.910234 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-5fc50071-7420-4921-a2b2-9d9b4398d1f7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:07.910847 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-5fc50071-7420-4921-a2b2-9d9b4398d1f7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:07.917441 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5fc50071-7420-4921-a2b2-9d9b4398d1f7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:07.917926 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5fc50071-7420-4921-a2b2-9d9b4398d1f7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:07.918405 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5fc50071-7420-4921-a2b2-9d9b4398d1f7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:07.919104 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5fc50071-7420-4921-a2b2-9d9b4398d1f7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:07.920088 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5fc50071-7420-4921-a2b2-9d9b4398d1f7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:07.920510 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5fc50071-7420-4921-a2b2-9d9b4398d1f7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:08.075058 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-5fc50071-7420-4921-a2b2-9d9b4398d1f7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:08.083789 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-5fc50071-7420-4921-a2b2-9d9b4398d1f7 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1753 microversion: 2.1 time: 0.177330 Sep 23 15:25:08.084399 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 286/589] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:07 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:08.129437 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-2b05a627-a89a-4d08-8920-ba6053fa7cc5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:08.130210 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-2b05a627-a89a-4d08-8920-ba6053fa7cc5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:08.136715 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2b05a627-a89a-4d08-8920-ba6053fa7cc5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:08.137183 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2b05a627-a89a-4d08-8920-ba6053fa7cc5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:08.137593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2b05a627-a89a-4d08-8920-ba6053fa7cc5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:08.138382 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2b05a627-a89a-4d08-8920-ba6053fa7cc5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:08.138745 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2b05a627-a89a-4d08-8920-ba6053fa7cc5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:08.139171 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2b05a627-a89a-4d08-8920-ba6053fa7cc5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:08.205565 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-2b05a627-a89a-4d08-8920-ba6053fa7cc5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:08.215622 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-2b05a627-a89a-4d08-8920-ba6053fa7cc5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:08.217556 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-2b05a627-a89a-4d08-8920-ba6053fa7cc5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:08.218888 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-2b05a627-a89a-4d08-8920-ba6053fa7cc5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1332 microversion: 2.20 time: 0.094665 Sep 23 15:25:08.219569 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 304/590] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:08 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:25:09.110575 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-383de0bc-efe7-4235-ba69-a84b0a292e55 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:09.111198 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-383de0bc-efe7-4235-ba69-a84b0a292e55 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:09.117303 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-383de0bc-efe7-4235-ba69-a84b0a292e55 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:09.117789 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-383de0bc-efe7-4235-ba69-a84b0a292e55 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:09.118573 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-383de0bc-efe7-4235-ba69-a84b0a292e55 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:09.119423 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-383de0bc-efe7-4235-ba69-a84b0a292e55 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:09.119922 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-383de0bc-efe7-4235-ba69-a84b0a292e55 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:09.120376 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-383de0bc-efe7-4235-ba69-a84b0a292e55 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:09.246966 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b2af6832-ba86-4675-8ca8-955913753745 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:09.247966 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-b2af6832-ba86-4675-8ca8-955913753745 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:09.256867 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b2af6832-ba86-4675-8ca8-955913753745 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:09.257350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b2af6832-ba86-4675-8ca8-955913753745 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:09.257889 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b2af6832-ba86-4675-8ca8-955913753745 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:09.259258 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b2af6832-ba86-4675-8ca8-955913753745 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:09.260228 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b2af6832-ba86-4675-8ca8-955913753745 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:09.260661 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b2af6832-ba86-4675-8ca8-955913753745 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:09.270027 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-383de0bc-efe7-4235-ba69-a84b0a292e55 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:09.275488 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-383de0bc-efe7-4235-ba69-a84b0a292e55 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1753 microversion: 2.1 time: 0.169439 Sep 23 15:25:09.276081 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 287/591] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:09 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:09.328388 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-b2af6832-ba86-4675-8ca8-955913753745 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:09.338129 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-b2af6832-ba86-4675-8ca8-955913753745 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:09.339561 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-b2af6832-ba86-4675-8ca8-955913753745 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:09.340705 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-b2af6832-ba86-4675-8ca8-955913753745 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1332 microversion: 2.20 time: 0.098583 Sep 23 15:25:09.341265 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 305/592] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:09 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:25:10.299576 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-e48beda0-ed5d-4e8c-93db-a5bff3a54e39 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:10.300236 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-e48beda0-ed5d-4e8c-93db-a5bff3a54e39 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:10.307828 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e48beda0-ed5d-4e8c-93db-a5bff3a54e39 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:10.308230 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e48beda0-ed5d-4e8c-93db-a5bff3a54e39 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:10.308685 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e48beda0-ed5d-4e8c-93db-a5bff3a54e39 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:10.309437 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e48beda0-ed5d-4e8c-93db-a5bff3a54e39 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:10.309899 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e48beda0-ed5d-4e8c-93db-a5bff3a54e39 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:10.310329 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e48beda0-ed5d-4e8c-93db-a5bff3a54e39 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:10.365199 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-5c5c7736-6549-4f8d-b0db-743262afb550 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:10.365813 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-5c5c7736-6549-4f8d-b0db-743262afb550 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:10.374601 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5c5c7736-6549-4f8d-b0db-743262afb550 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:10.379140 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5c5c7736-6549-4f8d-b0db-743262afb550 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:10.379140 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5c5c7736-6549-4f8d-b0db-743262afb550 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:10.379140 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5c5c7736-6549-4f8d-b0db-743262afb550 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:10.379140 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5c5c7736-6549-4f8d-b0db-743262afb550 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:10.379514 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5c5c7736-6549-4f8d-b0db-743262afb550 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:10.442915 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-5c5c7736-6549-4f8d-b0db-743262afb550 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:10.452074 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-5c5c7736-6549-4f8d-b0db-743262afb550 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:10.453497 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-5c5c7736-6549-4f8d-b0db-743262afb550 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:10.454588 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-5c5c7736-6549-4f8d-b0db-743262afb550 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1332 microversion: 2.20 time: 0.093576 Sep 23 15:25:10.455204 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 306/593] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:10 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1332 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:25:10.465165 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-e48beda0-ed5d-4e8c-93db-a5bff3a54e39 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:10.473613 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-e48beda0-ed5d-4e8c-93db-a5bff3a54e39 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1753 microversion: 2.1 time: 0.178374 Sep 23 15:25:10.474176 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 288/594] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:10 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:11.481016 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-7734c668-9e68-4ec0-8402-6433ad4666b8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:11.481613 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-7734c668-9e68-4ec0-8402-6433ad4666b8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:11.488378 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7734c668-9e68-4ec0-8402-6433ad4666b8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:11.488857 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7734c668-9e68-4ec0-8402-6433ad4666b8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:11.489462 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7734c668-9e68-4ec0-8402-6433ad4666b8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:11.490320 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7734c668-9e68-4ec0-8402-6433ad4666b8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:11.491462 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7734c668-9e68-4ec0-8402-6433ad4666b8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:11.492082 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7734c668-9e68-4ec0-8402-6433ad4666b8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:11.503966 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-96c8da59-5705-48c7-b351-c0c3937aeade tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:11.506210 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-96c8da59-5705-48c7-b351-c0c3937aeade tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:11.515792 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-96c8da59-5705-48c7-b351-c0c3937aeade tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:11.516949 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-96c8da59-5705-48c7-b351-c0c3937aeade tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:11.517895 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-96c8da59-5705-48c7-b351-c0c3937aeade tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:11.518884 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-96c8da59-5705-48c7-b351-c0c3937aeade tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:11.519640 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-96c8da59-5705-48c7-b351-c0c3937aeade tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:11.520318 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-96c8da59-5705-48c7-b351-c0c3937aeade tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:11.573393 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-7734c668-9e68-4ec0-8402-6433ad4666b8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:11.582348 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-7734c668-9e68-4ec0-8402-6433ad4666b8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:11.584061 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-7734c668-9e68-4ec0-8402-6433ad4666b8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:11.585536 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-7734c668-9e68-4ec0-8402-6433ad4666b8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1338 microversion: 2.20 time: 0.109385 Sep 23 15:25:11.586139 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 307/595] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:11 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1338 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:25:11.688995 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-96c8da59-5705-48c7-b351-c0c3937aeade tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:11.698547 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-96c8da59-5705-48c7-b351-c0c3937aeade tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1758 microversion: 2.1 time: 0.201623 Sep 23 15:25:11.700997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 289/596] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:11 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1758 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:25:12.614094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-0a84c7a0-4fb4-4d90-8dc1-409abb7811df tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:12.614859 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-0a84c7a0-4fb4-4d90-8dc1-409abb7811df tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:12.622477 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0a84c7a0-4fb4-4d90-8dc1-409abb7811df tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:12.623087 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0a84c7a0-4fb4-4d90-8dc1-409abb7811df tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:12.623590 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0a84c7a0-4fb4-4d90-8dc1-409abb7811df tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:12.624405 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0a84c7a0-4fb4-4d90-8dc1-409abb7811df tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:12.624994 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0a84c7a0-4fb4-4d90-8dc1-409abb7811df tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:12.625733 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0a84c7a0-4fb4-4d90-8dc1-409abb7811df tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:12.726497 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-2ebd8bfc-09d0-4e66-a41b-da157282e4b2 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:12.727110 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-2ebd8bfc-09d0-4e66-a41b-da157282e4b2 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:12.730784 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:12.737271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2ebd8bfc-09d0-4e66-a41b-da157282e4b2 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:12.737271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2ebd8bfc-09d0-4e66-a41b-da157282e4b2 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:12.737271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2ebd8bfc-09d0-4e66-a41b-da157282e4b2 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:12.737271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2ebd8bfc-09d0-4e66-a41b-da157282e4b2 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:12.746465 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2ebd8bfc-09d0-4e66-a41b-da157282e4b2 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:12.746465 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2ebd8bfc-09d0-4e66-a41b-da157282e4b2 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:12.840665 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-0a84c7a0-4fb4-4d90-8dc1-409abb7811df tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:12.849975 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-0a84c7a0-4fb4-4d90-8dc1-409abb7811df tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:12.851828 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-0a84c7a0-4fb4-4d90-8dc1-409abb7811df tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:12.853669 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-0a84c7a0-4fb4-4d90-8dc1-409abb7811df tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1406 microversion: 2.20 time: 0.243631 Sep 23 15:25:12.854799 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 308/597] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:12 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:25:12.920054 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-2ebd8bfc-09d0-4e66-a41b-da157282e4b2 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:12.927974 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-2ebd8bfc-09d0-4e66-a41b-da157282e4b2 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1758 microversion: 2.1 time: 0.205556 Sep 23 15:25:12.928580 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 290/598] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:12 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1758 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:25:13.081872 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-f1a32ee1-bfc4-48e6-9c58-afb8024bff83 req-87c84246-e3bc-4271-b233-5b7669317e0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46eb43e1-8a8e-4c5e-a071-ef900f024b55", "tag": "372595b3-5ccc-49a2-81d3-b61302bfa68d"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:25:13.092453 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-f1a32ee1-bfc4-48e6-9c58-afb8024bff83 req-87c84246-e3bc-4271-b233-5b7669317e0b service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:13.093025 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-f1a32ee1-bfc4-48e6-9c58-afb8024bff83 req-87c84246-e3bc-4271-b233-5b7669317e0b service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:13.093528 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-f1a32ee1-bfc4-48e6-9c58-afb8024bff83 req-87c84246-e3bc-4271-b233-5b7669317e0b service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:13.099100 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:13.107482 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-f1a32ee1-bfc4-48e6-9c58-afb8024bff83 req-87c84246-e3bc-4271-b233-5b7669317e0b service nova] Creating event network-changed:372595b3-5ccc-49a2-81d3-b61302bfa68d for instance 46eb43e1-8a8e-4c5e-a071-ef900f024b55 on hv-cinder-85530 Sep 23 15:25:13.115840 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-f1a32ee1-bfc4-48e6-9c58-afb8024bff83 req-87c84246-e3bc-4271-b233-5b7669317e0b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035217 Sep 23 15:25:13.116656 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 309/599] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:25:13.880930 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-33bfffec-5fe2-4fd4-a588-205ccde56698 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:13.881655 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-33bfffec-5fe2-4fd4-a588-205ccde56698 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:13.889519 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-33bfffec-5fe2-4fd4-a588-205ccde56698 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:13.890012 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-33bfffec-5fe2-4fd4-a588-205ccde56698 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:13.890450 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-33bfffec-5fe2-4fd4-a588-205ccde56698 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:13.891154 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-33bfffec-5fe2-4fd4-a588-205ccde56698 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:13.891606 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-33bfffec-5fe2-4fd4-a588-205ccde56698 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:13.892108 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-33bfffec-5fe2-4fd4-a588-205ccde56698 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:13.959252 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-891ffe32-fb15-4e87-955e-78caabef8ef6 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:13.960470 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-891ffe32-fb15-4e87-955e-78caabef8ef6 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:13.968349 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-891ffe32-fb15-4e87-955e-78caabef8ef6 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:13.968829 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-891ffe32-fb15-4e87-955e-78caabef8ef6 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:13.969259 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-891ffe32-fb15-4e87-955e-78caabef8ef6 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:13.969950 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-891ffe32-fb15-4e87-955e-78caabef8ef6 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:13.970410 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-891ffe32-fb15-4e87-955e-78caabef8ef6 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:13.971491 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-891ffe32-fb15-4e87-955e-78caabef8ef6 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:14.039131 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-33bfffec-5fe2-4fd4-a588-205ccde56698 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:14.048449 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-33bfffec-5fe2-4fd4-a588-205ccde56698 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:14.050062 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-33bfffec-5fe2-4fd4-a588-205ccde56698 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:14.051260 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-33bfffec-5fe2-4fd4-a588-205ccde56698 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1406 microversion: 2.20 time: 0.175060 Sep 23 15:25:14.051936 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 291/600] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:13 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:25:14.133456 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-891ffe32-fb15-4e87-955e-78caabef8ef6 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:14.142879 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-891ffe32-fb15-4e87-955e-78caabef8ef6 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1758 microversion: 2.1 time: 0.189619 Sep 23 15:25:14.143447 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 310/601] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:13 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1758 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:25:14.809338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-e8ceaa70-ee7c-47e9-aa64-526f8dd9bba4 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:14.809831 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-e8ceaa70-ee7c-47e9-aa64-526f8dd9bba4 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: f68f898c-130d-4eec-853c-db3269cb0fe4] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:14.816322 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e8ceaa70-ee7c-47e9-aa64-526f8dd9bba4 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:14.816814 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e8ceaa70-ee7c-47e9-aa64-526f8dd9bba4 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:14.817273 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e8ceaa70-ee7c-47e9-aa64-526f8dd9bba4 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:14.817949 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e8ceaa70-ee7c-47e9-aa64-526f8dd9bba4 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:14.818402 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e8ceaa70-ee7c-47e9-aa64-526f8dd9bba4 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:14.818823 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e8ceaa70-ee7c-47e9-aa64-526f8dd9bba4 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:14.903802 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.objects.instance [None req-e8ceaa70-ee7c-47e9-aa64-526f8dd9bba4 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lazy-loading 'services' on Instance uuid f68f898c-130d-4eec-853c-db3269cb0fe4 {{(pid=121448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:25:15.078299 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-2d6d72ef-f506-4f86-91a1-7fb56f97953f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:15.078877 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-2d6d72ef-f506-4f86-91a1-7fb56f97953f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:15.103799 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2d6d72ef-f506-4f86-91a1-7fb56f97953f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:15.103799 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2d6d72ef-f506-4f86-91a1-7fb56f97953f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:15.103799 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2d6d72ef-f506-4f86-91a1-7fb56f97953f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:15.103799 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2d6d72ef-f506-4f86-91a1-7fb56f97953f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:15.104416 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2d6d72ef-f506-4f86-91a1-7fb56f97953f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:15.104416 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2d6d72ef-f506-4f86-91a1-7fb56f97953f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:15.229478 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-2d6d72ef-f506-4f86-91a1-7fb56f97953f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:15.230681 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-e8ceaa70-ee7c-47e9-aa64-526f8dd9bba4 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "DELETE /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4/os-volume_attachments/6bf8c17f-c2aa-47d2-8c05-dd1048f71507" status: 202 len: 0 microversion: 2.1 time: 0.426089 Sep 23 15:25:15.231543 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 292/602] 10.222.0.55 () {58 vars in 1416 bytes} [Fri Sep 23 15:25:14 2022] DELETE /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4/os-volume_attachments/6bf8c17f-c2aa-47d2-8c05-dd1048f71507 => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 15:25:15.241591 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6717b686-dc25-441c-9ee0-93a14a4cb50b tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:15.242309 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-6717b686-dc25-441c-9ee0-93a14a4cb50b tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:15.244530 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-2d6d72ef-f506-4f86-91a1-7fb56f97953f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:15.248046 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-2d6d72ef-f506-4f86-91a1-7fb56f97953f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:15.249660 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6717b686-dc25-441c-9ee0-93a14a4cb50b tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:15.250156 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6717b686-dc25-441c-9ee0-93a14a4cb50b tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:15.250865 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6717b686-dc25-441c-9ee0-93a14a4cb50b tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:15.251113 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-2d6d72ef-f506-4f86-91a1-7fb56f97953f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1406 microversion: 2.20 time: 0.175665 Sep 23 15:25:15.251810 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6717b686-dc25-441c-9ee0-93a14a4cb50b tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:15.252311 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6717b686-dc25-441c-9ee0-93a14a4cb50b tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:15.252792 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6717b686-dc25-441c-9ee0-93a14a4cb50b tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:15.254002 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 311/603] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:15 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:25:15.440240 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6717b686-dc25-441c-9ee0-93a14a4cb50b tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:15.443875 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell0:SELECT=2 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:15.449856 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-6717b686-dc25-441c-9ee0-93a14a4cb50b tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1758 microversion: 2.1 time: 0.216927 Sep 23 15:25:15.450700 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 293/604] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:15 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1758 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:16.284542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-6e75ecfe-5886-4400-abad-4b671a42d4e5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:16.285204 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-6e75ecfe-5886-4400-abad-4b671a42d4e5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:16.287527 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell0:SELECT=6 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:16.294355 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e75ecfe-5886-4400-abad-4b671a42d4e5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:16.294860 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e75ecfe-5886-4400-abad-4b671a42d4e5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:16.295299 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e75ecfe-5886-4400-abad-4b671a42d4e5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:16.296067 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e75ecfe-5886-4400-abad-4b671a42d4e5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:16.296521 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e75ecfe-5886-4400-abad-4b671a42d4e5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:16.296940 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e75ecfe-5886-4400-abad-4b671a42d4e5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:16.457894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-6e75ecfe-5886-4400-abad-4b671a42d4e5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:16.467428 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-6e75ecfe-5886-4400-abad-4b671a42d4e5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:16.468906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-6e75ecfe-5886-4400-abad-4b671a42d4e5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:16.470029 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-6e75ecfe-5886-4400-abad-4b671a42d4e5 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1406 microversion: 2.20 time: 0.190602 Sep 23 15:25:16.470618 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 312/605] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:16 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:25:16.474942 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-0b7ffc5c-0526-4d0c-bf56-3593edffab51 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:16.475537 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-0b7ffc5c-0526-4d0c-bf56-3593edffab51 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:16.478290 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell0:SELECT=6 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:16.491060 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0b7ffc5c-0526-4d0c-bf56-3593edffab51 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:16.491588 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0b7ffc5c-0526-4d0c-bf56-3593edffab51 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:16.492084 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0b7ffc5c-0526-4d0c-bf56-3593edffab51 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:16.492944 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0b7ffc5c-0526-4d0c-bf56-3593edffab51 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:16.494033 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0b7ffc5c-0526-4d0c-bf56-3593edffab51 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:16.494472 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0b7ffc5c-0526-4d0c-bf56-3593edffab51 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:16.655455 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-0b7ffc5c-0526-4d0c-bf56-3593edffab51 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:16.664793 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-0b7ffc5c-0526-4d0c-bf56-3593edffab51 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1758 microversion: 2.1 time: 0.193730 Sep 23 15:25:16.665950 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 294/606] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:16 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1758 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:25:17.488524 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-55c8fa2d-ef04-4a64-bef7-6150fa63b07f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:17.489173 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-55c8fa2d-ef04-4a64-bef7-6150fa63b07f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: f68f898c-130d-4eec-853c-db3269cb0fe4] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:17.495463 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-ec733203-455f-4d12-9406-82eb8aaaf271 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:17.496190 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-ec733203-455f-4d12-9406-82eb8aaaf271 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:17.496353 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-55c8fa2d-ef04-4a64-bef7-6150fa63b07f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:17.496719 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-55c8fa2d-ef04-4a64-bef7-6150fa63b07f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:17.497156 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-55c8fa2d-ef04-4a64-bef7-6150fa63b07f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:17.497861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-55c8fa2d-ef04-4a64-bef7-6150fa63b07f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:17.498311 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-55c8fa2d-ef04-4a64-bef7-6150fa63b07f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:17.498754 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-55c8fa2d-ef04-4a64-bef7-6150fa63b07f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:17.503335 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ec733203-455f-4d12-9406-82eb8aaaf271 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:17.503840 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ec733203-455f-4d12-9406-82eb8aaaf271 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:17.504303 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ec733203-455f-4d12-9406-82eb8aaaf271 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:17.505033 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ec733203-455f-4d12-9406-82eb8aaaf271 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:17.505493 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ec733203-455f-4d12-9406-82eb8aaaf271 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:17.505930 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ec733203-455f-4d12-9406-82eb8aaaf271 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:17.526701 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-55c8fa2d-ef04-4a64-bef7-6150fa63b07f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: f68f898c-130d-4eec-853c-db3269cb0fe4] Going to try to terminate instance {{(pid=121450) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:25:17.528000 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:17.669809 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-ec733203-455f-4d12-9406-82eb8aaaf271 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:17.685605 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-ec733203-455f-4d12-9406-82eb8aaaf271 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:17.688583 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-ec733203-455f-4d12-9406-82eb8aaaf271 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:17.690725 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-ec733203-455f-4d12-9406-82eb8aaaf271 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1406 microversion: 2.20 time: 0.199349 Sep 23 15:25:17.691652 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 295/607] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:17 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:25:17.700861 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-4cf243a1-99cf-4568-a9ad-bd52dc3b8125 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:17.702048 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-4cf243a1-99cf-4568-a9ad-bd52dc3b8125 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:17.713335 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4cf243a1-99cf-4568-a9ad-bd52dc3b8125 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:17.714296 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4cf243a1-99cf-4568-a9ad-bd52dc3b8125 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:17.714985 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4cf243a1-99cf-4568-a9ad-bd52dc3b8125 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:17.716208 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4cf243a1-99cf-4568-a9ad-bd52dc3b8125 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:17.716994 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4cf243a1-99cf-4568-a9ad-bd52dc3b8125 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:17.717720 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4cf243a1-99cf-4568-a9ad-bd52dc3b8125 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:17.849240 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-55c8fa2d-ef04-4a64-bef7-6150fa63b07f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "DELETE /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4" status: 204 len: 0 microversion: 2.1 time: 0.363712 Sep 23 15:25:17.850465 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 313/608] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Sep 23 15:25:17 2022] DELETE /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:25:17.859114 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-e8785a52-ce8f-41c0-924e-3d155f0ed74f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:17.861334 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-e8785a52-ce8f-41c0-924e-3d155f0ed74f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: f68f898c-130d-4eec-853c-db3269cb0fe4] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:17.866216 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e8785a52-ce8f-41c0-924e-3d155f0ed74f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:17.866722 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e8785a52-ce8f-41c0-924e-3d155f0ed74f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:17.867181 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e8785a52-ce8f-41c0-924e-3d155f0ed74f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:17.867871 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e8785a52-ce8f-41c0-924e-3d155f0ed74f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:17.869099 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e8785a52-ce8f-41c0-924e-3d155f0ed74f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:17.869592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e8785a52-ce8f-41c0-924e-3d155f0ed74f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:17.886055 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-4cf243a1-99cf-4568-a9ad-bd52dc3b8125 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:17.894688 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-4cf243a1-99cf-4568-a9ad-bd52dc3b8125 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1758 microversion: 2.1 time: 0.201555 Sep 23 15:25:17.895266 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 296/609] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:17 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1758 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:18.006246 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-e8785a52-ce8f-41c0-924e-3d155f0ed74f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:18.014221 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-e8785a52-ce8f-41c0-924e-3d155f0ed74f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4" status: 200 len: 1515 microversion: 2.1 time: 0.159343 Sep 23 15:25:18.014790 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 314/610] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:17 2022] GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:25:18.717804 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-9cf7206b-32b7-4964-84f6-c621c1377e20 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:18.718455 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-9cf7206b-32b7-4964-84f6-c621c1377e20 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:18.725072 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9cf7206b-32b7-4964-84f6-c621c1377e20 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:18.725668 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9cf7206b-32b7-4964-84f6-c621c1377e20 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:18.726114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9cf7206b-32b7-4964-84f6-c621c1377e20 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:18.726842 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9cf7206b-32b7-4964-84f6-c621c1377e20 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:18.727360 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9cf7206b-32b7-4964-84f6-c621c1377e20 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:18.728425 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9cf7206b-32b7-4964-84f6-c621c1377e20 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:18.862620 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-9cf7206b-32b7-4964-84f6-c621c1377e20 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:18.870954 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-9cf7206b-32b7-4964-84f6-c621c1377e20 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:18.872430 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-9cf7206b-32b7-4964-84f6-c621c1377e20 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:18.873541 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-9cf7206b-32b7-4964-84f6-c621c1377e20 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1406 microversion: 2.20 time: 0.159813 Sep 23 15:25:18.874097 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 297/611] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:18 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:25:18.918252 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-78894caf-05aa-42a9-ae4c-053d31ff7119 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:18.918830 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-78894caf-05aa-42a9-ae4c-053d31ff7119 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:18.925369 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-78894caf-05aa-42a9-ae4c-053d31ff7119 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:18.925851 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-78894caf-05aa-42a9-ae4c-053d31ff7119 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:18.926288 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-78894caf-05aa-42a9-ae4c-053d31ff7119 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:18.927006 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-78894caf-05aa-42a9-ae4c-053d31ff7119 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:18.927464 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-78894caf-05aa-42a9-ae4c-053d31ff7119 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:18.927888 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-78894caf-05aa-42a9-ae4c-053d31ff7119 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:19.037849 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-b0c629e8-d960-472e-9434-5f4530d4e872 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:19.042573 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-b0c629e8-d960-472e-9434-5f4530d4e872 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: f68f898c-130d-4eec-853c-db3269cb0fe4] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:19.044618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b0c629e8-d960-472e-9434-5f4530d4e872 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:19.045113 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b0c629e8-d960-472e-9434-5f4530d4e872 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:19.045549 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b0c629e8-d960-472e-9434-5f4530d4e872 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:19.046244 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b0c629e8-d960-472e-9434-5f4530d4e872 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:19.046711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b0c629e8-d960-472e-9434-5f4530d4e872 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:19.047135 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b0c629e8-d960-472e-9434-5f4530d4e872 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:19.076291 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-78894caf-05aa-42a9-ae4c-053d31ff7119 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:19.086051 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-78894caf-05aa-42a9-ae4c-053d31ff7119 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1758 microversion: 2.1 time: 0.171728 Sep 23 15:25:19.086630 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 315/612] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:18 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:19.183571 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b0c629e8-d960-472e-9434-5f4530d4e872 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:19.191335 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-b0c629e8-d960-472e-9434-5f4530d4e872 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4" status: 200 len: 1515 microversion: 2.1 time: 0.157674 Sep 23 15:25:19.191902 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 298/613] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:19 2022] GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:25:19.957406 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-3d901c2f-df22-4996-9b57-5b5f9b7b31e6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:19.958054 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-3d901c2f-df22-4996-9b57-5b5f9b7b31e6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:19.965042 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3d901c2f-df22-4996-9b57-5b5f9b7b31e6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:19.965530 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3d901c2f-df22-4996-9b57-5b5f9b7b31e6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:19.965987 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3d901c2f-df22-4996-9b57-5b5f9b7b31e6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:19.966697 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3d901c2f-df22-4996-9b57-5b5f9b7b31e6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:19.967146 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3d901c2f-df22-4996-9b57-5b5f9b7b31e6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:19.967574 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3d901c2f-df22-4996-9b57-5b5f9b7b31e6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:20.100763 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-3d901c2f-df22-4996-9b57-5b5f9b7b31e6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:20.109983 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6060a49b-c3f6-4d35-9422-45e9acb6a948 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:20.110512 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-3d901c2f-df22-4996-9b57-5b5f9b7b31e6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:20.110750 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-6060a49b-c3f6-4d35-9422-45e9acb6a948 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:20.111698 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-3d901c2f-df22-4996-9b57-5b5f9b7b31e6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:20.112922 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-3d901c2f-df22-4996-9b57-5b5f9b7b31e6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1406 microversion: 2.20 time: 0.218117 Sep 23 15:25:20.113488 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 316/614] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:19 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:25:20.117839 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6060a49b-c3f6-4d35-9422-45e9acb6a948 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:20.119072 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6060a49b-c3f6-4d35-9422-45e9acb6a948 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:20.119577 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6060a49b-c3f6-4d35-9422-45e9acb6a948 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:20.120313 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6060a49b-c3f6-4d35-9422-45e9acb6a948 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:20.120776 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6060a49b-c3f6-4d35-9422-45e9acb6a948 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:20.121227 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6060a49b-c3f6-4d35-9422-45e9acb6a948 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:20.215569 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-25a6c668-5f82-43a3-970f-9f4d843d8c8f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:20.216224 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-25a6c668-5f82-43a3-970f-9f4d843d8c8f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: f68f898c-130d-4eec-853c-db3269cb0fe4] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:20.232697 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-25a6c668-5f82-43a3-970f-9f4d843d8c8f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:20.233189 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-25a6c668-5f82-43a3-970f-9f4d843d8c8f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:20.233618 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-25a6c668-5f82-43a3-970f-9f4d843d8c8f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:20.234323 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-25a6c668-5f82-43a3-970f-9f4d843d8c8f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:20.234765 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-25a6c668-5f82-43a3-970f-9f4d843d8c8f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:20.235185 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-25a6c668-5f82-43a3-970f-9f4d843d8c8f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:20.291088 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6060a49b-c3f6-4d35-9422-45e9acb6a948 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:20.304460 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-25a6c668-5f82-43a3-970f-9f4d843d8c8f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:20.306383 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-6060a49b-c3f6-4d35-9422-45e9acb6a948 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1758 microversion: 2.1 time: 0.200391 Sep 23 15:25:20.307024 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 299/615] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:20 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1758 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:25:20.311887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-d95992be-8f59-4280-a979-cd957796b55c req-e144a0a1-bba8-46f5-bf49-1d7b75541b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f68f898c-130d-4eec-853c-db3269cb0fe4", "name": "network-vif-deleted", "tag": "792915ae-417d-47c8-9b7b-c0d355d202c7"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:25:20.316911 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-25a6c668-5f82-43a3-970f-9f4d843d8c8f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4" status: 200 len: 1473 microversion: 2.1 time: 0.105349 Sep 23 15:25:20.318108 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 317/616] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:20 2022] GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4 => generated 1473 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:25:20.322670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-d95992be-8f59-4280-a979-cd957796b55c req-e144a0a1-bba8-46f5-bf49-1d7b75541b1a service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:20.323412 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-d95992be-8f59-4280-a979-cd957796b55c req-e144a0a1-bba8-46f5-bf49-1d7b75541b1a service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:20.323849 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-d95992be-8f59-4280-a979-cd957796b55c req-e144a0a1-bba8-46f5-bf49-1d7b75541b1a service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:20.339908 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-d95992be-8f59-4280-a979-cd957796b55c req-e144a0a1-bba8-46f5-bf49-1d7b75541b1a service nova] Creating event network-vif-deleted:792915ae-417d-47c8-9b7b-c0d355d202c7 for instance f68f898c-130d-4eec-853c-db3269cb0fe4 on hv-cinder-85530 Sep 23 15:25:20.345069 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-d95992be-8f59-4280-a979-cd957796b55c req-e144a0a1-bba8-46f5-bf49-1d7b75541b1a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036684 Sep 23 15:25:20.345877 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 300/617] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:25:20.370698 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-2e4d00f4-bf54-4e96-a312-a4ac614ec526 req-b892f82f-cbc9-4ee1-94d0-40f0566f51c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46eb43e1-8a8e-4c5e-a071-ef900f024b55", "name": "network-vif-plugged", "status": "completed", "tag": "372595b3-5ccc-49a2-81d3-b61302bfa68d"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:25:20.380463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-2e4d00f4-bf54-4e96-a312-a4ac614ec526 req-b892f82f-cbc9-4ee1-94d0-40f0566f51c4 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:20.380937 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-2e4d00f4-bf54-4e96-a312-a4ac614ec526 req-b892f82f-cbc9-4ee1-94d0-40f0566f51c4 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:20.381366 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-2e4d00f4-bf54-4e96-a312-a4ac614ec526 req-b892f82f-cbc9-4ee1-94d0-40f0566f51c4 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:20.392713 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-2e4d00f4-bf54-4e96-a312-a4ac614ec526 req-b892f82f-cbc9-4ee1-94d0-40f0566f51c4 service nova] Creating event network-vif-plugged:372595b3-5ccc-49a2-81d3-b61302bfa68d for instance 46eb43e1-8a8e-4c5e-a071-ef900f024b55 on hv-cinder-85530 Sep 23 15:25:20.397583 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-2e4d00f4-bf54-4e96-a312-a4ac614ec526 req-b892f82f-cbc9-4ee1-94d0-40f0566f51c4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030869 Sep 23 15:25:20.398207 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 318/618] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:25:21.137921 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-3ce5df2b-542f-461c-8805-daf58f98d4d3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:21.138653 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-3ce5df2b-542f-461c-8805-daf58f98d4d3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:21.144793 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3ce5df2b-542f-461c-8805-daf58f98d4d3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:21.145274 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3ce5df2b-542f-461c-8805-daf58f98d4d3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:21.145760 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3ce5df2b-542f-461c-8805-daf58f98d4d3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:21.146404 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3ce5df2b-542f-461c-8805-daf58f98d4d3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:21.146861 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3ce5df2b-542f-461c-8805-daf58f98d4d3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:21.147303 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3ce5df2b-542f-461c-8805-daf58f98d4d3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:21.282122 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-3ce5df2b-542f-461c-8805-daf58f98d4d3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:21.291160 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-3ce5df2b-542f-461c-8805-daf58f98d4d3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:21.292692 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-3ce5df2b-542f-461c-8805-daf58f98d4d3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:21.293838 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-3ce5df2b-542f-461c-8805-daf58f98d4d3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1406 microversion: 2.20 time: 0.160619 Sep 23 15:25:21.294412 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 301/619] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:21 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:25:21.331536 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a181d30f-3c2c-4c44-a0ef-04eb001a5c21 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:21.332445 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-a181d30f-3c2c-4c44-a0ef-04eb001a5c21 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:21.338696 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a181d30f-3c2c-4c44-a0ef-04eb001a5c21 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:21.339179 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a181d30f-3c2c-4c44-a0ef-04eb001a5c21 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:21.339616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a181d30f-3c2c-4c44-a0ef-04eb001a5c21 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:21.340342 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a181d30f-3c2c-4c44-a0ef-04eb001a5c21 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:21.340794 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a181d30f-3c2c-4c44-a0ef-04eb001a5c21 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:21.341253 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a181d30f-3c2c-4c44-a0ef-04eb001a5c21 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:21.343386 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-9e91e1fa-2b0e-49f2-af1f-8e24fc0edd0f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:21.344260 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-9e91e1fa-2b0e-49f2-af1f-8e24fc0edd0f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: f68f898c-130d-4eec-853c-db3269cb0fe4] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:21.350091 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9e91e1fa-2b0e-49f2-af1f-8e24fc0edd0f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:21.350576 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9e91e1fa-2b0e-49f2-af1f-8e24fc0edd0f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:21.351020 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9e91e1fa-2b0e-49f2-af1f-8e24fc0edd0f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:21.351715 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9e91e1fa-2b0e-49f2-af1f-8e24fc0edd0f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:21.352207 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9e91e1fa-2b0e-49f2-af1f-8e24fc0edd0f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:21.353133 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9e91e1fa-2b0e-49f2-af1f-8e24fc0edd0f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:21.387505 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9e91e1fa-2b0e-49f2-af1f-8e24fc0edd0f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:21.388003 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9e91e1fa-2b0e-49f2-af1f-8e24fc0edd0f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:21.388457 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9e91e1fa-2b0e-49f2-af1f-8e24fc0edd0f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:21.388931 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.objects.instance [None req-9e91e1fa-2b0e-49f2-af1f-8e24fc0edd0f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lazy-loading 'fault' on Instance uuid f68f898c-130d-4eec-853c-db3269cb0fe4 {{(pid=121448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:25:21.432864 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-9e91e1fa-2b0e-49f2-af1f-8e24fc0edd0f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:21.440787 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-9e91e1fa-2b0e-49f2-af1f-8e24fc0edd0f tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4" status: 200 len: 1309 microversion: 2.1 time: 0.101118 Sep 23 15:25:21.441362 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 302/620] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:21 2022] GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:25:21.488985 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a181d30f-3c2c-4c44-a0ef-04eb001a5c21 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:21.498514 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-a181d30f-3c2c-4c44-a0ef-04eb001a5c21 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1758 microversion: 2.1 time: 0.171535 Sep 23 15:25:21.499275 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 319/621] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:21 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:22.319095 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-10e8bbff-f709-4da1-800c-d7e624a9cdbf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:22.319698 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-10e8bbff-f709-4da1-800c-d7e624a9cdbf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:22.327037 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-10e8bbff-f709-4da1-800c-d7e624a9cdbf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:22.327525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-10e8bbff-f709-4da1-800c-d7e624a9cdbf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:22.328024 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-10e8bbff-f709-4da1-800c-d7e624a9cdbf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:22.328696 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-10e8bbff-f709-4da1-800c-d7e624a9cdbf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:22.329159 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-10e8bbff-f709-4da1-800c-d7e624a9cdbf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:22.329592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-10e8bbff-f709-4da1-800c-d7e624a9cdbf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:22.465897 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-10e8bbff-f709-4da1-800c-d7e624a9cdbf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:22.467728 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-64e69e8a-7c64-4656-ba7d-0bdd7ba2b734 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:22.468780 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-64e69e8a-7c64-4656-ba7d-0bdd7ba2b734 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: f68f898c-130d-4eec-853c-db3269cb0fe4] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:22.479443 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-10e8bbff-f709-4da1-800c-d7e624a9cdbf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:22.485165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-64e69e8a-7c64-4656-ba7d-0bdd7ba2b734 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:22.485165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-64e69e8a-7c64-4656-ba7d-0bdd7ba2b734 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:22.485165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-64e69e8a-7c64-4656-ba7d-0bdd7ba2b734 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:22.485505 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-10e8bbff-f709-4da1-800c-d7e624a9cdbf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:22.485617 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-64e69e8a-7c64-4656-ba7d-0bdd7ba2b734 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:22.485617 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-64e69e8a-7c64-4656-ba7d-0bdd7ba2b734 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:22.485790 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-10e8bbff-f709-4da1-800c-d7e624a9cdbf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1406 microversion: 2.20 time: 0.166947 Sep 23 15:25:22.485894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-64e69e8a-7c64-4656-ba7d-0bdd7ba2b734 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:22.485985 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 303/622] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:22 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:25:22.514261 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-64e69e8a-7c64-4656-ba7d-0bdd7ba2b734 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:22.514754 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-64e69e8a-7c64-4656-ba7d-0bdd7ba2b734 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:22.515191 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-64e69e8a-7c64-4656-ba7d-0bdd7ba2b734 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:22.515774 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.objects.instance [None req-64e69e8a-7c64-4656-ba7d-0bdd7ba2b734 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lazy-loading 'fault' on Instance uuid f68f898c-130d-4eec-853c-db3269cb0fe4 {{(pid=121450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:25:22.523268 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-851b43a1-884e-4411-9c1d-3eadf15727ab tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:22.523895 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-851b43a1-884e-4411-9c1d-3eadf15727ab tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:22.530941 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-851b43a1-884e-4411-9c1d-3eadf15727ab tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:22.531488 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-851b43a1-884e-4411-9c1d-3eadf15727ab tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:22.531935 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-851b43a1-884e-4411-9c1d-3eadf15727ab tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:22.532673 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-851b43a1-884e-4411-9c1d-3eadf15727ab tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:22.533132 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-851b43a1-884e-4411-9c1d-3eadf15727ab tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:22.533565 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-851b43a1-884e-4411-9c1d-3eadf15727ab tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:22.560270 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-64e69e8a-7c64-4656-ba7d-0bdd7ba2b734 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee65edb3211b4b71a771594a90a342ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9488f4d4af441168341205e0e936ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:22.568002 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-64e69e8a-7c64-4656-ba7d-0bdd7ba2b734 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4" status: 200 len: 1309 microversion: 2.1 time: 0.107570 Sep 23 15:25:22.576993 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 320/623] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:22 2022] GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4 => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:25:22.678387 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-851b43a1-884e-4411-9c1d-3eadf15727ab tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:22.687263 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-851b43a1-884e-4411-9c1d-3eadf15727ab tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1758 microversion: 2.1 time: 0.168992 Sep 23 15:25:22.687840 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 304/624] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:22 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:23.506542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-86a65796-6697-4827-929a-3e61fd3935bc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:23.507171 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-86a65796-6697-4827-929a-3e61fd3935bc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:23.513946 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-86a65796-6697-4827-929a-3e61fd3935bc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:23.514423 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-86a65796-6697-4827-929a-3e61fd3935bc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:23.514871 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-86a65796-6697-4827-929a-3e61fd3935bc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:23.515542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-86a65796-6697-4827-929a-3e61fd3935bc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:23.516144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-86a65796-6697-4827-929a-3e61fd3935bc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:23.516885 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-86a65796-6697-4827-929a-3e61fd3935bc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:23.548678 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-dc7091bc-08a0-4ade-9780-5559c74dfcf4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:23.549268 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-dc7091bc-08a0-4ade-9780-5559c74dfcf4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:23.556706 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dc7091bc-08a0-4ade-9780-5559c74dfcf4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:23.557204 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dc7091bc-08a0-4ade-9780-5559c74dfcf4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:23.557649 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dc7091bc-08a0-4ade-9780-5559c74dfcf4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:23.558455 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dc7091bc-08a0-4ade-9780-5559c74dfcf4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:23.558949 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dc7091bc-08a0-4ade-9780-5559c74dfcf4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:23.559375 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dc7091bc-08a0-4ade-9780-5559c74dfcf4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:23.651460 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.objects.instance [None req-dc7091bc-08a0-4ade-9780-5559c74dfcf4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lazy-loading 'services' on Instance uuid 7d2de5a1-7ae9-4010-a7fc-5d2f45212418 {{(pid=121448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:25:23.663066 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-86a65796-6697-4827-929a-3e61fd3935bc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:23.672193 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-86a65796-6697-4827-929a-3e61fd3935bc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:23.673642 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-86a65796-6697-4827-929a-3e61fd3935bc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:23.674801 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-86a65796-6697-4827-929a-3e61fd3935bc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1598 microversion: 2.20 time: 0.172100 Sep 23 15:25:23.675394 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 321/625] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:23 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1598 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:25:23.679730 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-324bf80e-19c8-4665-8088-5dfe378758d2 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:23.682694 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-324bf80e-19c8-4665-8088-5dfe378758d2 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] [instance: f68f898c-130d-4eec-853c-db3269cb0fe4] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:23.686884 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-324bf80e-19c8-4665-8088-5dfe378758d2 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:23.687365 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-324bf80e-19c8-4665-8088-5dfe378758d2 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:23.687801 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-324bf80e-19c8-4665-8088-5dfe378758d2 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:23.688527 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-324bf80e-19c8-4665-8088-5dfe378758d2 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:23.688978 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-324bf80e-19c8-4665-8088-5dfe378758d2 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:23.689398 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-324bf80e-19c8-4665-8088-5dfe378758d2 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:23.704516 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-324bf80e-19c8-4665-8088-5dfe378758d2 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] HTTP exception thrown: Instance f68f898c-130d-4eec-853c-db3269cb0fe4 could not be found. Sep 23 15:25:23.709183 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-324bf80e-19c8-4665-8088-5dfe378758d2 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Request method failure captured: Sep 23 15:25:23.709183 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4 HTTP/1.1 Sep 23 15:25:23.709183 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:25:23.709183 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:25:23.709183 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:25:23.709183 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:25:23.709183 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:25:23.709183 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:25:23.709183 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:25:23.709183 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:25:23.709183 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLc9BdPT7UOwhvdG4kOdodh7E68UjR9IbfeUmL7WA-Rl7SEsqZCN-uO9HzPMxwdEjoJCP_rQixEn6ZLLUm-grWTurzKFJA4SZ3UdDx8anSma40u9N4eZw2vVJWuviRXIuh05PY6yr220RjQ-466_t7SnyqJFE15vjBnW_BEfKg8Sf29A Sep 23 15:25:23.709183 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:25:23.709183 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:25:23.709183 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:25:23.709183 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:25:23.709183 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:25:23.709183 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:25:23.709183 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: c9488f4d4af441168341205e0e936ce4 Sep 23 15:25:23.709183 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-VolumesSnapshotTestJSON-712624210 Sep 23 15:25:23.709183 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:25:23.709183 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:25:23.710845 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/c9488f4d4af441168341205e0e936ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c9488f4d4af441168341205e0e936ce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_c9488f4d4af441168341205e0e936ce4", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c9488f4d4af441168341205e0e936ce4"}]}] Sep 23 15:25:23.710845 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-VolumesSnapshotTestJSON-712624210 Sep 23 15:25:23.710845 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: c9488f4d4af441168341205e0e936ce4 Sep 23 15:25:23.710845 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-712624210 Sep 23 15:25:23.710845 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-VolumesSnapshotTestJSON-712624210-project Sep 23 15:25:23.710845 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:25:23.710845 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:25:23.710845 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: ee65edb3211b4b71a771594a90a342ff Sep 23 15:25:23.710845 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-VolumesSnapshotTestJSON-712624210-project Sep 23 15:25:23.710845 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:25:23.710845 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance f68f898c-130d-4eec-853c-db3269cb0fe4 could not be found. Sep 23 15:25:23.710845 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': 'f68f898c-130d-4eec-853c-db3269cb0fe4'} Sep 23 15:25:23.712319 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:25:23.712319 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:25:23.712319 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:25:23.712319 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:25:23.712319 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:25:23.712319 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:25:23.712319 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:25:23.712319 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:25:23.712319 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:25:23.712319 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:25:23.712319 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f68f898c-130d-4eec-853c-db3269cb0fe4 could not be found. Sep 23 15:25:23.712319 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:25:23.712319 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:25:23.712319 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:25:23.712319 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:25:23.712319 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:25:23.712319 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:25:23.712319 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:25:23.712319 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:25:23.712319 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:25:23.714640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:25:23.714640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:25:23.714640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:25:23.714640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:25:23.714640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:25:23.714640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:25:23.714640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:25:23.714640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f68f898c-130d-4eec-853c-db3269cb0fe4 could not be found. Sep 23 15:25:23.714640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:25:23.714640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:25:23.714640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:25:23.714640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:25:23.714640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:25:23.714640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:25:23.714640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:25:23.714640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:25:23.714640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f68f898c-130d-4eec-853c-db3269cb0fe4 could not be found. Sep 23 15:25:23.714640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:25:23.716118 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-324bf80e-19c8-4665-8088-5dfe378758d2 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] Returning 404 to user: Instance f68f898c-130d-4eec-853c-db3269cb0fe4 could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:25:23.716118 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-324bf80e-19c8-4665-8088-5dfe378758d2 tempest-VolumesSnapshotTestJSON-712624210 tempest-VolumesSnapshotTestJSON-712624210-project] 10.222.0.55 "GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4" status: 404 len: 111 microversion: 2.1 time: 0.031598 Sep 23 15:25:23.716118 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 322/626] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:23 2022] GET /compute/v2.1/servers/f68f898c-130d-4eec-853c-db3269cb0fe4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:25:23.720912 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-2be44230-5995-4a27-a8db-b72b777051cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:23.721401 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-2be44230-5995-4a27-a8db-b72b777051cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:23.729465 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2be44230-5995-4a27-a8db-b72b777051cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:23.730032 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2be44230-5995-4a27-a8db-b72b777051cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:23.730378 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2be44230-5995-4a27-a8db-b72b777051cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:23.731062 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2be44230-5995-4a27-a8db-b72b777051cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:23.731514 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2be44230-5995-4a27-a8db-b72b777051cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:23.731935 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2be44230-5995-4a27-a8db-b72b777051cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:23.814724 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-2be44230-5995-4a27-a8db-b72b777051cc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.104961 Sep 23 15:25:23.815430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 323/627] 10.222.0.55 () {60 vars in 1316 bytes} [Fri Sep 23 15:25:23 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:25:23.821509 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-382b3e4d-fff3-49e0-89b8-b5d181bd7dbe tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:23.822665 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-382b3e4d-fff3-49e0-89b8-b5d181bd7dbe tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:23.831338 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-382b3e4d-fff3-49e0-89b8-b5d181bd7dbe tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:23.832522 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-382b3e4d-fff3-49e0-89b8-b5d181bd7dbe tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:23.838275 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-382b3e4d-fff3-49e0-89b8-b5d181bd7dbe tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:23.838275 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-382b3e4d-fff3-49e0-89b8-b5d181bd7dbe tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:23.838275 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-382b3e4d-fff3-49e0-89b8-b5d181bd7dbe tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:23.838275 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-382b3e4d-fff3-49e0-89b8-b5d181bd7dbe tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:23.951329 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-dc7091bc-08a0-4ade-9780-5559c74dfcf4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "DELETE /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/os-volume_attachments/d4e45e19-dd49-4cb5-ac88-ad010ec221b6" status: 202 len: 0 microversion: 2.1 time: 0.406324 Sep 23 15:25:23.952294 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 305/628] 10.222.0.55 () {58 vars in 1416 bytes} [Fri Sep 23 15:25:23 2022] DELETE /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/os-volume_attachments/d4e45e19-dd49-4cb5-ac88-ad010ec221b6 => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 15:25:23.974625 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-3b1d2c5d-5f6f-4e55-aa6b-cb7edc83cb99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:23.979483 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-3b1d2c5d-5f6f-4e55-aa6b-cb7edc83cb99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:23.986010 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3b1d2c5d-5f6f-4e55-aa6b-cb7edc83cb99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:23.986538 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3b1d2c5d-5f6f-4e55-aa6b-cb7edc83cb99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:23.986954 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3b1d2c5d-5f6f-4e55-aa6b-cb7edc83cb99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:23.987658 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3b1d2c5d-5f6f-4e55-aa6b-cb7edc83cb99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:23.988144 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3b1d2c5d-5f6f-4e55-aa6b-cb7edc83cb99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:23.988741 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3b1d2c5d-5f6f-4e55-aa6b-cb7edc83cb99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:24.041645 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-3b1d2c5d-5f6f-4e55-aa6b-cb7edc83cb99 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080585 Sep 23 15:25:24.042517 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 306/629] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Sep 23 15:25:23 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:25:24.127466 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-53f5c0b9-c20f-402d-95c6-066702d213e6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:24.129647 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-53f5c0b9-c20f-402d-95c6-066702d213e6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:24.135259 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-382b3e4d-fff3-49e0-89b8-b5d181bd7dbe tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:24.143348 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-53f5c0b9-c20f-402d-95c6-066702d213e6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:24.144383 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-53f5c0b9-c20f-402d-95c6-066702d213e6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:24.144606 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-382b3e4d-fff3-49e0-89b8-b5d181bd7dbe tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1761 microversion: 2.1 time: 0.327873 Sep 23 15:25:24.145257 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-53f5c0b9-c20f-402d-95c6-066702d213e6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:24.146209 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-53f5c0b9-c20f-402d-95c6-066702d213e6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:24.147225 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-53f5c0b9-c20f-402d-95c6-066702d213e6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:24.147945 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-53f5c0b9-c20f-402d-95c6-066702d213e6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:24.163636 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 324/630] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:23 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1761 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:24.186494 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-53f5c0b9-c20f-402d-95c6-066702d213e6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064335 Sep 23 15:25:24.187071 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 307/631] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Sep 23 15:25:24 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 15:25:24.255486 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-65e9ecd8-287a-4428-b2c6-25ab949e132c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:24.256062 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-65e9ecd8-287a-4428-b2c6-25ab949e132c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:24.263339 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-65e9ecd8-287a-4428-b2c6-25ab949e132c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:24.266585 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-65e9ecd8-287a-4428-b2c6-25ab949e132c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:24.266585 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-65e9ecd8-287a-4428-b2c6-25ab949e132c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:24.266585 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-65e9ecd8-287a-4428-b2c6-25ab949e132c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:24.266585 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-65e9ecd8-287a-4428-b2c6-25ab949e132c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:24.266930 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-65e9ecd8-287a-4428-b2c6-25ab949e132c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:24.293645 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-65e9ecd8-287a-4428-b2c6-25ab949e132c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Going to try to terminate instance {{(pid=121450) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:25:24.309954 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:24.685196 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-65e9ecd8-287a-4428-b2c6-25ab949e132c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "DELETE /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 204 len: 0 microversion: 2.1 time: 0.433346 Sep 23 15:25:24.688051 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 325/632] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Sep 23 15:25:24 2022] DELETE /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:25:24.694464 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-29a9dd99-5282-411d-b42f-15cc08a12721 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:24.695079 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-29a9dd99-5282-411d-b42f-15cc08a12721 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:24.704337 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-29a9dd99-5282-411d-b42f-15cc08a12721 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:24.705020 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-29a9dd99-5282-411d-b42f-15cc08a12721 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:24.705467 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-29a9dd99-5282-411d-b42f-15cc08a12721 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:24.706172 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-29a9dd99-5282-411d-b42f-15cc08a12721 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:24.706808 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-29a9dd99-5282-411d-b42f-15cc08a12721 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:24.707392 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-29a9dd99-5282-411d-b42f-15cc08a12721 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:24.855816 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-29a9dd99-5282-411d-b42f-15cc08a12721 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:24.864073 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-29a9dd99-5282-411d-b42f-15cc08a12721 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1672 microversion: 2.1 time: 0.173272 Sep 23 15:25:24.864658 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 308/633] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:24 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1672 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:25.055275 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-3ebba135-836d-48b2-918c-2870438acb80 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:25.058236 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-3ebba135-836d-48b2-918c-2870438acb80 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:25.065085 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3ebba135-836d-48b2-918c-2870438acb80 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:25.065573 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3ebba135-836d-48b2-918c-2870438acb80 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:25.066011 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3ebba135-836d-48b2-918c-2870438acb80 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:25.066699 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3ebba135-836d-48b2-918c-2870438acb80 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:25.067373 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3ebba135-836d-48b2-918c-2870438acb80 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:25.067947 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3ebba135-836d-48b2-918c-2870438acb80 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:25.100282 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-3ebba135-836d-48b2-918c-2870438acb80 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049289 Sep 23 15:25:25.100849 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 326/634] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Sep 23 15:25:25 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:25:25.245076 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-ec477f69-a750-4589-8da1-49acbd1fba95 req-7934719b-d676-49b0-9ed9-dc4f1420fbc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46eb43e1-8a8e-4c5e-a071-ef900f024b55", "tag": "372595b3-5ccc-49a2-81d3-b61302bfa68d"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:25:25.255560 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-ec477f69-a750-4589-8da1-49acbd1fba95 req-7934719b-d676-49b0-9ed9-dc4f1420fbc3 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:25.258109 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-ec477f69-a750-4589-8da1-49acbd1fba95 req-7934719b-d676-49b0-9ed9-dc4f1420fbc3 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:25.258109 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-ec477f69-a750-4589-8da1-49acbd1fba95 req-7934719b-d676-49b0-9ed9-dc4f1420fbc3 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:25.267745 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-ec477f69-a750-4589-8da1-49acbd1fba95 req-7934719b-d676-49b0-9ed9-dc4f1420fbc3 service nova] Creating event network-changed:372595b3-5ccc-49a2-81d3-b61302bfa68d for instance 46eb43e1-8a8e-4c5e-a071-ef900f024b55 on hv-cinder-85530 Sep 23 15:25:25.273226 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-ec477f69-a750-4589-8da1-49acbd1fba95 req-7934719b-d676-49b0-9ed9-dc4f1420fbc3 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032173 Sep 23 15:25:25.273754 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 309/635] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:25:25.889509 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-62866ba3-cd1b-4b37-95a5-41648ad3a152 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:25.890132 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-62866ba3-cd1b-4b37-95a5-41648ad3a152 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:25.897214 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-62866ba3-cd1b-4b37-95a5-41648ad3a152 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:25.897701 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-62866ba3-cd1b-4b37-95a5-41648ad3a152 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:25.898202 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-62866ba3-cd1b-4b37-95a5-41648ad3a152 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:25.898935 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-62866ba3-cd1b-4b37-95a5-41648ad3a152 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:25.899609 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-62866ba3-cd1b-4b37-95a5-41648ad3a152 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:25.900122 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-62866ba3-cd1b-4b37-95a5-41648ad3a152 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:26.047239 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-62866ba3-cd1b-4b37-95a5-41648ad3a152 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:26.055227 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-62866ba3-cd1b-4b37-95a5-41648ad3a152 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1672 microversion: 2.1 time: 0.169555 Sep 23 15:25:26.056410 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 327/636] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:25 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1672 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:26.113524 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-4721a911-39e2-45c3-ae7d-4619747b32b1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:26.115914 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-4721a911-39e2-45c3-ae7d-4619747b32b1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:26.123958 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4721a911-39e2-45c3-ae7d-4619747b32b1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:26.124484 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4721a911-39e2-45c3-ae7d-4619747b32b1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:26.125313 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4721a911-39e2-45c3-ae7d-4619747b32b1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:26.126046 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4721a911-39e2-45c3-ae7d-4619747b32b1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:26.126523 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4721a911-39e2-45c3-ae7d-4619747b32b1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:26.126947 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4721a911-39e2-45c3-ae7d-4619747b32b1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:26.165945 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-4721a911-39e2-45c3-ae7d-4619747b32b1 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053994 Sep 23 15:25:26.165945 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 310/637] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Sep 23 15:25:26 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:25:27.080481 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-676f14ac-b7ff-4bd9-8720-274dd40747b9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:27.081095 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-676f14ac-b7ff-4bd9-8720-274dd40747b9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:27.087664 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-676f14ac-b7ff-4bd9-8720-274dd40747b9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:27.098658 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-676f14ac-b7ff-4bd9-8720-274dd40747b9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:27.098658 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-676f14ac-b7ff-4bd9-8720-274dd40747b9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:27.098658 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-676f14ac-b7ff-4bd9-8720-274dd40747b9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:27.098658 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-676f14ac-b7ff-4bd9-8720-274dd40747b9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:27.099039 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-676f14ac-b7ff-4bd9-8720-274dd40747b9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:27.175056 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-f2adc3ef-d1ad-4de2-bf0c-90542fe44385 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:27.177366 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-f2adc3ef-d1ad-4de2-bf0c-90542fe44385 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:27.185157 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f2adc3ef-d1ad-4de2-bf0c-90542fe44385 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:27.185679 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f2adc3ef-d1ad-4de2-bf0c-90542fe44385 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:27.186123 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f2adc3ef-d1ad-4de2-bf0c-90542fe44385 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:27.187100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f2adc3ef-d1ad-4de2-bf0c-90542fe44385 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:27.187593 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f2adc3ef-d1ad-4de2-bf0c-90542fe44385 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:27.188070 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f2adc3ef-d1ad-4de2-bf0c-90542fe44385 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:27.222390 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-f2adc3ef-d1ad-4de2-bf0c-90542fe44385 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051393 Sep 23 15:25:27.222984 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 311/638] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Sep 23 15:25:27 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:25:27.227828 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-676f14ac-b7ff-4bd9-8720-274dd40747b9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:27.236548 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-676f14ac-b7ff-4bd9-8720-274dd40747b9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1672 microversion: 2.1 time: 0.160104 Sep 23 15:25:27.237128 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 328/639] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:27 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:28.234876 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-2fe00725-3286-4b8d-a2cd-2a282122d490 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:28.237109 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-2fe00725-3286-4b8d-a2cd-2a282122d490 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:28.243478 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2fe00725-3286-4b8d-a2cd-2a282122d490 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:28.243959 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2fe00725-3286-4b8d-a2cd-2a282122d490 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:28.245001 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2fe00725-3286-4b8d-a2cd-2a282122d490 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:28.245696 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2fe00725-3286-4b8d-a2cd-2a282122d490 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:28.246151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2fe00725-3286-4b8d-a2cd-2a282122d490 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:28.246588 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2fe00725-3286-4b8d-a2cd-2a282122d490 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:28.259747 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-ae76ca56-2554-4309-a531-4d4e823588ce tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:28.261258 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-ae76ca56-2554-4309-a531-4d4e823588ce tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:28.264610 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:28.267918 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ae76ca56-2554-4309-a531-4d4e823588ce tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:28.268576 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ae76ca56-2554-4309-a531-4d4e823588ce tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:28.269026 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ae76ca56-2554-4309-a531-4d4e823588ce tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:28.269725 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ae76ca56-2554-4309-a531-4d4e823588ce tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:28.270185 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ae76ca56-2554-4309-a531-4d4e823588ce tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:28.270610 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ae76ca56-2554-4309-a531-4d4e823588ce tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:28.277840 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-2fe00725-3286-4b8d-a2cd-2a282122d490 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046917 Sep 23 15:25:28.280796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 312/640] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Sep 23 15:25:28 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:25:28.404772 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-ae76ca56-2554-4309-a531-4d4e823588ce tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:28.412751 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-ae76ca56-2554-4309-a531-4d4e823588ce tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1672 microversion: 2.1 time: 0.156871 Sep 23 15:25:28.413319 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 329/641] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:28 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:25:29.290780 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-b104b8d0-1bc3-42c3-8239-67cabad1abe8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:29.294783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-b104b8d0-1bc3-42c3-8239-67cabad1abe8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:29.307585 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b104b8d0-1bc3-42c3-8239-67cabad1abe8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:29.308516 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b104b8d0-1bc3-42c3-8239-67cabad1abe8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:29.309301 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b104b8d0-1bc3-42c3-8239-67cabad1abe8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:29.310611 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b104b8d0-1bc3-42c3-8239-67cabad1abe8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:29.311432 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b104b8d0-1bc3-42c3-8239-67cabad1abe8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:29.312257 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b104b8d0-1bc3-42c3-8239-67cabad1abe8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:29.366848 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-b104b8d0-1bc3-42c3-8239-67cabad1abe8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081065 Sep 23 15:25:29.367398 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 313/642] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Sep 23 15:25:29 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:25:29.437859 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-894b402a-0d98-4bfc-bfe0-9cadc342109f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:29.438533 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-894b402a-0d98-4bfc-bfe0-9cadc342109f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:29.445427 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-894b402a-0d98-4bfc-bfe0-9cadc342109f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:29.445914 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-894b402a-0d98-4bfc-bfe0-9cadc342109f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:29.446350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-894b402a-0d98-4bfc-bfe0-9cadc342109f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:29.447051 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-894b402a-0d98-4bfc-bfe0-9cadc342109f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:29.448291 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-894b402a-0d98-4bfc-bfe0-9cadc342109f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:29.448990 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-894b402a-0d98-4bfc-bfe0-9cadc342109f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:29.796737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-894b402a-0d98-4bfc-bfe0-9cadc342109f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:29.805270 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-894b402a-0d98-4bfc-bfe0-9cadc342109f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1672 microversion: 2.1 time: 0.371726 Sep 23 15:25:29.806152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 330/643] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:29 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1672 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:30.379748 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-be05da57-b57b-42e3-9a51-f539b86198b8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:30.382024 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-be05da57-b57b-42e3-9a51-f539b86198b8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:30.389635 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-be05da57-b57b-42e3-9a51-f539b86198b8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:30.390128 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-be05da57-b57b-42e3-9a51-f539b86198b8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:30.390570 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-be05da57-b57b-42e3-9a51-f539b86198b8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:30.391270 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-be05da57-b57b-42e3-9a51-f539b86198b8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:30.391728 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-be05da57-b57b-42e3-9a51-f539b86198b8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:30.392188 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-be05da57-b57b-42e3-9a51-f539b86198b8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:30.421989 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-be05da57-b57b-42e3-9a51-f539b86198b8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046147 Sep 23 15:25:30.422703 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 314/644] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Sep 23 15:25:30 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 15:25:30.506914 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-5e9e9fff-6ee5-4ae0-8ee9-f51928eb9888 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:30.507499 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-5e9e9fff-6ee5-4ae0-8ee9-f51928eb9888 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:30.514951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5e9e9fff-6ee5-4ae0-8ee9-f51928eb9888 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:30.515468 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5e9e9fff-6ee5-4ae0-8ee9-f51928eb9888 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:30.515972 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5e9e9fff-6ee5-4ae0-8ee9-f51928eb9888 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:30.516978 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5e9e9fff-6ee5-4ae0-8ee9-f51928eb9888 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:30.517441 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5e9e9fff-6ee5-4ae0-8ee9-f51928eb9888 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:30.517868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5e9e9fff-6ee5-4ae0-8ee9-f51928eb9888 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:30.544666 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-5e9e9fff-6ee5-4ae0-8ee9-f51928eb9888 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Going to try to terminate instance {{(pid=121450) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:25:30.617373 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-ccdf8711-a2e4-48ca-906e-f11887de5547 req-e02e3cb0-7f70-4c8a-81c7-3769399b0a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5523ab-9085-47cd-9133-f65554b59f0f", "name": "network-vif-deleted", "tag": "55424de1-677b-4c57-a21b-d9eb905f5fc7"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:25:30.617373 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-ccdf8711-a2e4-48ca-906e-f11887de5547 req-e02e3cb0-7f70-4c8a-81c7-3769399b0a9d service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:30.617373 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-ccdf8711-a2e4-48ca-906e-f11887de5547 req-e02e3cb0-7f70-4c8a-81c7-3769399b0a9d service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:30.617774 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-ccdf8711-a2e4-48ca-906e-f11887de5547 req-e02e3cb0-7f70-4c8a-81c7-3769399b0a9d service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:30.630037 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-ccdf8711-a2e4-48ca-906e-f11887de5547 req-e02e3cb0-7f70-4c8a-81c7-3769399b0a9d service nova] Creating event network-vif-deleted:55424de1-677b-4c57-a21b-d9eb905f5fc7 for instance 1c5523ab-9085-47cd-9133-f65554b59f0f on hv-cinder-85530 Sep 23 15:25:30.635495 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-ccdf8711-a2e4-48ca-906e-f11887de5547 req-e02e3cb0-7f70-4c8a-81c7-3769399b0a9d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031024 Sep 23 15:25:30.636329 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 315/645] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:25:30.831062 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-f77d3521-cefb-4e2c-a1e9-5fd2c12dbb5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:30.833504 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-f77d3521-cefb-4e2c-a1e9-5fd2c12dbb5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:30.841664 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f77d3521-cefb-4e2c-a1e9-5fd2c12dbb5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:30.842166 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f77d3521-cefb-4e2c-a1e9-5fd2c12dbb5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:30.842614 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f77d3521-cefb-4e2c-a1e9-5fd2c12dbb5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:30.843331 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f77d3521-cefb-4e2c-a1e9-5fd2c12dbb5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:30.843994 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f77d3521-cefb-4e2c-a1e9-5fd2c12dbb5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:30.844630 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f77d3521-cefb-4e2c-a1e9-5fd2c12dbb5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:30.913768 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-f77d3521-cefb-4e2c-a1e9-5fd2c12dbb5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:30.924532 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-f77d3521-cefb-4e2c-a1e9-5fd2c12dbb5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1322 microversion: 2.1 time: 0.097802 Sep 23 15:25:30.925205 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 316/646] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:30 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1322 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:25:31.039122 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-5e9e9fff-6ee5-4ae0-8ee9-f51928eb9888 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "DELETE /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 204 len: 0 microversion: 2.1 time: 0.535704 Sep 23 15:25:31.039779 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 331/647] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Sep 23 15:25:30 2022] DELETE /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:25:31.049511 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-56436835-2d04-4803-ab3a-b0c4d35c1890 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:31.054327 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-56436835-2d04-4803-ab3a-b0c4d35c1890 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:31.056375 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-56436835-2d04-4803-ab3a-b0c4d35c1890 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:31.057602 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-56436835-2d04-4803-ab3a-b0c4d35c1890 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:31.058048 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-56436835-2d04-4803-ab3a-b0c4d35c1890 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:31.058901 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-56436835-2d04-4803-ab3a-b0c4d35c1890 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:31.059374 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-56436835-2d04-4803-ab3a-b0c4d35c1890 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:31.059894 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-56436835-2d04-4803-ab3a-b0c4d35c1890 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:31.199563 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-56436835-2d04-4803-ab3a-b0c4d35c1890 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:31.208029 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-56436835-2d04-4803-ab3a-b0c4d35c1890 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1691 microversion: 2.1 time: 0.162443 Sep 23 15:25:31.208542 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 317/648] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:31 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:25:31.951415 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-9d973137-794e-47eb-8f14-671248a2af78 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:31.952112 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-9d973137-794e-47eb-8f14-671248a2af78 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:31.957967 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9d973137-794e-47eb-8f14-671248a2af78 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:31.958490 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9d973137-794e-47eb-8f14-671248a2af78 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:31.958919 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9d973137-794e-47eb-8f14-671248a2af78 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:31.959593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9d973137-794e-47eb-8f14-671248a2af78 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:31.960065 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9d973137-794e-47eb-8f14-671248a2af78 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:31.960481 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9d973137-794e-47eb-8f14-671248a2af78 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:31.991882 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9d973137-794e-47eb-8f14-671248a2af78 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:31.992415 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9d973137-794e-47eb-8f14-671248a2af78 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:31.992806 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9d973137-794e-47eb-8f14-671248a2af78 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:31.993241 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.objects.instance [None req-9d973137-794e-47eb-8f14-671248a2af78 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lazy-loading 'fault' on Instance uuid 1c5523ab-9085-47cd-9133-f65554b59f0f {{(pid=121450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:25:32.040108 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-9d973137-794e-47eb-8f14-671248a2af78 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:32.044513 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-9d973137-794e-47eb-8f14-671248a2af78 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1327 microversion: 2.1 time: 0.097896 Sep 23 15:25:32.045082 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 332/649] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:31 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:32.232029 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-798c69a4-9030-4e77-94cb-da63d656bbe8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:32.232687 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-798c69a4-9030-4e77-94cb-da63d656bbe8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:32.239222 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-798c69a4-9030-4e77-94cb-da63d656bbe8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:32.239708 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-798c69a4-9030-4e77-94cb-da63d656bbe8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:32.240176 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-798c69a4-9030-4e77-94cb-da63d656bbe8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:32.240869 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-798c69a4-9030-4e77-94cb-da63d656bbe8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:32.241322 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-798c69a4-9030-4e77-94cb-da63d656bbe8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:32.241750 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-798c69a4-9030-4e77-94cb-da63d656bbe8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:32.378574 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-798c69a4-9030-4e77-94cb-da63d656bbe8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:32.387643 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-798c69a4-9030-4e77-94cb-da63d656bbe8 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1691 microversion: 2.1 time: 0.159608 Sep 23 15:25:32.388242 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 318/650] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:32 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:33.068111 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-f7cfa4d5-2e75-4cfa-acb7-9b347d29c39c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:33.068711 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-f7cfa4d5-2e75-4cfa-acb7-9b347d29c39c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:33.075280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f7cfa4d5-2e75-4cfa-acb7-9b347d29c39c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:33.075761 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f7cfa4d5-2e75-4cfa-acb7-9b347d29c39c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:33.076234 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f7cfa4d5-2e75-4cfa-acb7-9b347d29c39c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:33.076927 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f7cfa4d5-2e75-4cfa-acb7-9b347d29c39c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:33.077395 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f7cfa4d5-2e75-4cfa-acb7-9b347d29c39c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:33.077808 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f7cfa4d5-2e75-4cfa-acb7-9b347d29c39c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:33.106288 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=3 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:33.109733 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f7cfa4d5-2e75-4cfa-acb7-9b347d29c39c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:33.110277 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f7cfa4d5-2e75-4cfa-acb7-9b347d29c39c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:33.110704 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f7cfa4d5-2e75-4cfa-acb7-9b347d29c39c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:33.111147 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.objects.instance [None req-f7cfa4d5-2e75-4cfa-acb7-9b347d29c39c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lazy-loading 'fault' on Instance uuid 1c5523ab-9085-47cd-9133-f65554b59f0f {{(pid=121450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:25:33.153832 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-f7cfa4d5-2e75-4cfa-acb7-9b347d29c39c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:33.161654 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-f7cfa4d5-2e75-4cfa-acb7-9b347d29c39c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1327 microversion: 2.1 time: 0.097480 Sep 23 15:25:33.162215 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 333/651] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:33 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:33.412265 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-f0ea7571-d6cc-45c3-a96b-05d875573078 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:33.412898 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-f0ea7571-d6cc-45c3-a96b-05d875573078 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:33.419673 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f0ea7571-d6cc-45c3-a96b-05d875573078 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:33.420184 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f0ea7571-d6cc-45c3-a96b-05d875573078 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:33.420618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f0ea7571-d6cc-45c3-a96b-05d875573078 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:33.421314 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f0ea7571-d6cc-45c3-a96b-05d875573078 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:33.421763 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f0ea7571-d6cc-45c3-a96b-05d875573078 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:33.422182 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f0ea7571-d6cc-45c3-a96b-05d875573078 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:33.554836 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-f0ea7571-d6cc-45c3-a96b-05d875573078 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:33.563251 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-f0ea7571-d6cc-45c3-a96b-05d875573078 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1691 microversion: 2.1 time: 0.155024 Sep 23 15:25:33.576002 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 319/652] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:33 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:34.186698 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-2471c1bc-63a3-4c3e-b99f-84a358843276 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:34.187312 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-2471c1bc-63a3-4c3e-b99f-84a358843276 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:34.194437 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2471c1bc-63a3-4c3e-b99f-84a358843276 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:34.195210 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2471c1bc-63a3-4c3e-b99f-84a358843276 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:34.195355 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2471c1bc-63a3-4c3e-b99f-84a358843276 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:34.196151 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2471c1bc-63a3-4c3e-b99f-84a358843276 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:34.196626 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2471c1bc-63a3-4c3e-b99f-84a358843276 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:34.197663 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2471c1bc-63a3-4c3e-b99f-84a358843276 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:34.231658 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2471c1bc-63a3-4c3e-b99f-84a358843276 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:34.232184 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2471c1bc-63a3-4c3e-b99f-84a358843276 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:34.232686 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2471c1bc-63a3-4c3e-b99f-84a358843276 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:34.233129 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.objects.instance [None req-2471c1bc-63a3-4c3e-b99f-84a358843276 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lazy-loading 'fault' on Instance uuid 1c5523ab-9085-47cd-9133-f65554b59f0f {{(pid=121450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:25:34.278028 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-2471c1bc-63a3-4c3e-b99f-84a358843276 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:34.286418 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-2471c1bc-63a3-4c3e-b99f-84a358843276 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1327 microversion: 2.1 time: 0.105103 Sep 23 15:25:34.287008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 334/653] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:34 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:34.586576 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-73a57c30-b1b1-48b9-adec-d120e74b1f7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:34.587230 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-73a57c30-b1b1-48b9-adec-d120e74b1f7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:34.593784 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-73a57c30-b1b1-48b9-adec-d120e74b1f7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:34.594266 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-73a57c30-b1b1-48b9-adec-d120e74b1f7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:34.594695 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-73a57c30-b1b1-48b9-adec-d120e74b1f7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:34.595385 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-73a57c30-b1b1-48b9-adec-d120e74b1f7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:34.595839 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-73a57c30-b1b1-48b9-adec-d120e74b1f7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:34.596293 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-73a57c30-b1b1-48b9-adec-d120e74b1f7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:34.738617 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-73a57c30-b1b1-48b9-adec-d120e74b1f7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:34.747515 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-73a57c30-b1b1-48b9-adec-d120e74b1f7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1691 microversion: 2.1 time: 0.164795 Sep 23 15:25:34.748095 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 320/654] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:34 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:35.312221 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-7e3fddf5-d672-401c-a91d-bc5e64104096 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:35.312831 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-7e3fddf5-d672-401c-a91d-bc5e64104096 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:35.319861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7e3fddf5-d672-401c-a91d-bc5e64104096 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:35.320761 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7e3fddf5-d672-401c-a91d-bc5e64104096 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:35.321386 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7e3fddf5-d672-401c-a91d-bc5e64104096 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:35.322138 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7e3fddf5-d672-401c-a91d-bc5e64104096 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:35.322591 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7e3fddf5-d672-401c-a91d-bc5e64104096 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:35.323013 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7e3fddf5-d672-401c-a91d-bc5e64104096 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:35.361925 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7e3fddf5-d672-401c-a91d-bc5e64104096 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:35.362767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7e3fddf5-d672-401c-a91d-bc5e64104096 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:35.363206 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7e3fddf5-d672-401c-a91d-bc5e64104096 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:35.364219 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.objects.instance [None req-7e3fddf5-d672-401c-a91d-bc5e64104096 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lazy-loading 'fault' on Instance uuid 1c5523ab-9085-47cd-9133-f65554b59f0f {{(pid=121450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:25:35.439075 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-7e3fddf5-d672-401c-a91d-bc5e64104096 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:35.448003 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-7e3fddf5-d672-401c-a91d-bc5e64104096 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 200 len: 1327 microversion: 2.1 time: 0.140523 Sep 23 15:25:35.448621 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 335/655] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:35 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 1327 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:25:35.770635 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-3c486c3a-af37-4cb6-9b53-0c77b923045f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:35.771601 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-3c486c3a-af37-4cb6-9b53-0c77b923045f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:35.779203 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3c486c3a-af37-4cb6-9b53-0c77b923045f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:35.779700 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3c486c3a-af37-4cb6-9b53-0c77b923045f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:35.780246 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3c486c3a-af37-4cb6-9b53-0c77b923045f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:35.780991 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3c486c3a-af37-4cb6-9b53-0c77b923045f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:35.781458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3c486c3a-af37-4cb6-9b53-0c77b923045f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:35.781895 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3c486c3a-af37-4cb6-9b53-0c77b923045f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:35.847820 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-3c486c3a-af37-4cb6-9b53-0c77b923045f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:35.856907 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-3c486c3a-af37-4cb6-9b53-0c77b923045f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1623 microversion: 2.1 time: 0.090041 Sep 23 15:25:35.857643 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 321/656] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:35 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1623 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:36.035295 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-04a9eb4f-f45c-4236-8241-fc868380626c req-15e8cadc-5d7d-4229-8285-b1495d51776f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d2de5a1-7ae9-4010-a7fc-5d2f45212418", "name": "network-vif-deleted", "tag": "7d99929c-386a-4e5e-bc8f-6751a85b69b8"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:25:36.046286 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-04a9eb4f-f45c-4236-8241-fc868380626c req-15e8cadc-5d7d-4229-8285-b1495d51776f service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:36.046804 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-04a9eb4f-f45c-4236-8241-fc868380626c req-15e8cadc-5d7d-4229-8285-b1495d51776f service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:36.047211 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-04a9eb4f-f45c-4236-8241-fc868380626c req-15e8cadc-5d7d-4229-8285-b1495d51776f service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:36.061231 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-04a9eb4f-f45c-4236-8241-fc868380626c req-15e8cadc-5d7d-4229-8285-b1495d51776f service nova] Creating event network-vif-deleted:7d99929c-386a-4e5e-bc8f-6751a85b69b8 for instance 7d2de5a1-7ae9-4010-a7fc-5d2f45212418 on hv-cinder-85530 Sep 23 15:25:36.070993 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-04a9eb4f-f45c-4236-8241-fc868380626c req-15e8cadc-5d7d-4229-8285-b1495d51776f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039968 Sep 23 15:25:36.071672 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 336/657] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:25:36.471003 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-ffc291b2-a011-4153-b49b-6a4301634c85 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:36.471711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-ffc291b2-a011-4153-b49b-6a4301634c85 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:36.481756 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ffc291b2-a011-4153-b49b-6a4301634c85 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:36.481756 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ffc291b2-a011-4153-b49b-6a4301634c85 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:36.481756 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ffc291b2-a011-4153-b49b-6a4301634c85 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:36.481756 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ffc291b2-a011-4153-b49b-6a4301634c85 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:36.482172 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ffc291b2-a011-4153-b49b-6a4301634c85 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:36.482172 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ffc291b2-a011-4153-b49b-6a4301634c85 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:36.495332 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.wsgi [None req-ffc291b2-a011-4153-b49b-6a4301634c85 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] HTTP exception thrown: Instance 1c5523ab-9085-47cd-9133-f65554b59f0f could not be found. Sep 23 15:25:36.497114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-ffc291b2-a011-4153-b49b-6a4301634c85 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Request method failure captured: Sep 23 15:25:36.497114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: request: GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f HTTP/1.1 Sep 23 15:25:36.497114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept: application/json Sep 23 15:25:36.497114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept-Encoding: identity Sep 23 15:25:36.497114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Connection: close Sep 23 15:25:36.497114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Length: 0 Sep 23 15:25:36.497114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Type: application/json Sep 23 15:25:36.497114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Host: 10.222.0.55 Sep 23 15:25:36.497114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Openstack-System-Scope: None Sep 23 15:25:36.497114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: User-Agent: python-urllib3/1.26.12 Sep 23 15:25:36.497114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Auth-Token: gAAAAABjLc6pTJg1az4Ztuh3qoUewU2vUIYF2UNMVycjpGT92b5ptyf0bTzHt6IOxB68C19pjhprHNzQyPKZFOrJndeA8-qkVlagw5impOAkU-3NZNReUk5d3hfw0bnXnOe0zvPho_U3zxHsi2bLIkww6dgmrCSYkKMrcHNoBDM3NRpWyNJzlgk Sep 23 15:25:36.497114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Id: None Sep 23 15:25:36.497114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Name: None Sep 23 15:25:36.497114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Identity-Status: Confirmed Sep 23 15:25:36.497114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Is-Admin-Project: True Sep 23 15:25:36.497114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Id: default Sep 23 15:25:36.497114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Name: Default Sep 23 15:25:36.497114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Id: ab19e9f7cb0e49548a9ab74b9d2b4aec Sep 23 15:25:36.497114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Name: tempest-AttachVolumeTestJSON-1011211645 Sep 23 15:25:36.497114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Role: reader,member Sep 23 15:25:36.497114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Roles: reader,member Sep 23 15:25:36.498885 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ab19e9f7cb0e49548a9ab74b9d2b4aec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ab19e9f7cb0e49548a9ab74b9d2b4aec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ab19e9f7cb0e49548a9ab74b9d2b4aec", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ab19e9f7cb0e49548a9ab74b9d2b4aec"}]}] Sep 23 15:25:36.498885 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant: tempest-AttachVolumeTestJSON-1011211645 Sep 23 15:25:36.498885 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Id: ab19e9f7cb0e49548a9ab74b9d2b4aec Sep 23 15:25:36.498885 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1011211645 Sep 23 15:25:36.498885 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User: tempest-AttachVolumeTestJSON-1011211645-project Sep 23 15:25:36.498885 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Id: default Sep 23 15:25:36.498885 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Name: Default Sep 23 15:25:36.498885 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Id: f5f0ecaf38e74c96bc439fde75d93d37 Sep 23 15:25:36.498885 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Name: tempest-AttachVolumeTestJSON-1011211645-project Sep 23 15:25:36.498885 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: method: > Sep 23 15:25:36.498885 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: exception: Instance 1c5523ab-9085-47cd-9133-f65554b59f0f could not be found. Sep 23 15:25:36.498885 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: action_args: {'id': '1c5523ab-9085-47cd-9133-f65554b59f0f'} Sep 23 15:25:36.500350 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:25:36.500350 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:25:36.500350 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:25:36.500350 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:25:36.500350 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:25:36.500350 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:25:36.500350 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:25:36.500350 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:25:36.500350 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:25:36.500350 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:25:36.500350 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c5523ab-9085-47cd-9133-f65554b59f0f could not be found. Sep 23 15:25:36.500350 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:25:36.500350 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:25:36.500350 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:25:36.500350 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:25:36.500350 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:25:36.500350 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:25:36.500350 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:25:36.500350 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:25:36.500350 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:25:36.501887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:25:36.501887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:25:36.501887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:25:36.501887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:25:36.501887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:25:36.501887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:25:36.501887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:25:36.501887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c5523ab-9085-47cd-9133-f65554b59f0f could not be found. Sep 23 15:25:36.501887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:25:36.501887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:25:36.501887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:25:36.501887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:25:36.501887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:25:36.501887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:25:36.501887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:25:36.501887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:25:36.501887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c5523ab-9085-47cd-9133-f65554b59f0f could not be found. Sep 23 15:25:36.501887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:25:36.503514 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-ffc291b2-a011-4153-b49b-6a4301634c85 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Returning 404 to user: Instance 1c5523ab-9085-47cd-9133-f65554b59f0f could not be found. {{(pid=121448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:25:36.503514 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-ffc291b2-a011-4153-b49b-6a4301634c85 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 404 len: 111 microversion: 2.1 time: 0.031706 Sep 23 15:25:36.503514 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 322/658] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:36 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:25:36.510761 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-ff2aafe2-c27a-48be-9f7e-8c8f1548074f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '.version_select at 0x7f82db9df8b0>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:36.631857 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-ff2aafe2-c27a-48be-9f7e-8c8f1548074f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1705444444" status: 202 len: 0 microversion: 2.1 time: 0.126966 Sep 23 15:25:36.632492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 337/659] 10.222.0.55 () {58 vars in 1221 bytes} [Fri Sep 23 15:25:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1705444444 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:25:36.881185 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-86372efe-49df-40a8-9e96-31428ba734d2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:36.881848 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-86372efe-49df-40a8-9e96-31428ba734d2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:36.889569 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-86372efe-49df-40a8-9e96-31428ba734d2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:36.890058 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-86372efe-49df-40a8-9e96-31428ba734d2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:36.890765 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-86372efe-49df-40a8-9e96-31428ba734d2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:36.891503 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-86372efe-49df-40a8-9e96-31428ba734d2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:36.892013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-86372efe-49df-40a8-9e96-31428ba734d2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:36.892449 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-86372efe-49df-40a8-9e96-31428ba734d2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:36.981094 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-86372efe-49df-40a8-9e96-31428ba734d2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:36.991079 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-86372efe-49df-40a8-9e96-31428ba734d2 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1330 microversion: 2.1 time: 0.113682 Sep 23 15:25:36.991812 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 323/660] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:36 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1330 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:37.814266 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-497ed64f-4cc4-45cc-877e-5723296ea807 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Action: 'create', calling method: .version_select at 0x7f82db892430>, body: {"keypair": {"name": "tempest-keypair-631336205", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0CoSkYZLfwdmEjnh0Qsy5ZxQBIPeosFlB2XIwWSjddeA4iY2Be74jK/bP2H3zEU2vAtG65u/3R+RaMwuZw+kkVVwv8VoZy7grQrLGVaC1mRD+DNfVkERNn2OtUklnbNA=="}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:25:37.830387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-497ed64f-4cc4-45cc-877e-5723296ea807 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Getting quotas for project ab19e9f7cb0e49548a9ab74b9d2b4aec. Resources: {'key_pairs'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:25:37.834166 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-497ed64f-4cc4-45cc-877e-5723296ea807 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Getting quotas for user f5f0ecaf38e74c96bc439fde75d93d37 and project ab19e9f7cb0e49548a9ab74b9d2b4aec. Resources: {'key_pairs'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:25:37.931689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-497ed64f-4cc4-45cc-877e-5723296ea807 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.121829 Sep 23 15:25:37.932389 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 338/661] 10.222.0.55 () {60 vars in 1159 bytes} [Fri Sep 23 15:25:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:25:38.015458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-eb2d45fb-e160-444e-b903-191e4bd5f225 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:38.016135 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-eb2d45fb-e160-444e-b903-191e4bd5f225 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:38.022782 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-eb2d45fb-e160-444e-b903-191e4bd5f225 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:38.023262 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-eb2d45fb-e160-444e-b903-191e4bd5f225 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:38.023694 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-eb2d45fb-e160-444e-b903-191e4bd5f225 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:38.024714 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-eb2d45fb-e160-444e-b903-191e4bd5f225 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:38.025741 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-eb2d45fb-e160-444e-b903-191e4bd5f225 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:38.026199 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-eb2d45fb-e160-444e-b903-191e4bd5f225 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:38.095230 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-eb2d45fb-e160-444e-b903-191e4bd5f225 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:38.103160 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-eb2d45fb-e160-444e-b903-191e4bd5f225 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1330 microversion: 2.1 time: 0.091644 Sep 23 15:25:38.104356 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 324/662] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:38 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1330 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:25:39.126889 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-879768d5-c15e-40ac-806e-a7191139db04 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:39.127813 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-879768d5-c15e-40ac-806e-a7191139db04 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:39.136826 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-879768d5-c15e-40ac-806e-a7191139db04 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:39.137321 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-879768d5-c15e-40ac-806e-a7191139db04 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:39.137763 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-879768d5-c15e-40ac-806e-a7191139db04 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:39.138473 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-879768d5-c15e-40ac-806e-a7191139db04 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:39.138949 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-879768d5-c15e-40ac-806e-a7191139db04 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:39.139362 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-879768d5-c15e-40ac-806e-a7191139db04 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:39.174116 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-879768d5-c15e-40ac-806e-a7191139db04 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:39.174608 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-879768d5-c15e-40ac-806e-a7191139db04 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:39.175044 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-879768d5-c15e-40ac-806e-a7191139db04 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:39.175484 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.objects.instance [None req-879768d5-c15e-40ac-806e-a7191139db04 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lazy-loading 'fault' on Instance uuid 7d2de5a1-7ae9-4010-a7fc-5d2f45212418 {{(pid=121450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:25:39.219569 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-879768d5-c15e-40ac-806e-a7191139db04 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:39.227646 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-879768d5-c15e-40ac-806e-a7191139db04 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 200 len: 1335 microversion: 2.1 time: 0.105634 Sep 23 15:25:39.228255 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 339/663] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:39 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 1335 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:40.252047 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a202906b-ff85-49e6-9de1-4bd2832023fe tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:40.252633 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-a202906b-ff85-49e6-9de1-4bd2832023fe tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 7d2de5a1-7ae9-4010-a7fc-5d2f45212418] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:40.260091 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a202906b-ff85-49e6-9de1-4bd2832023fe tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:40.262548 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a202906b-ff85-49e6-9de1-4bd2832023fe tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:40.262548 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a202906b-ff85-49e6-9de1-4bd2832023fe tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:40.262548 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a202906b-ff85-49e6-9de1-4bd2832023fe tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:40.262548 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a202906b-ff85-49e6-9de1-4bd2832023fe tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:40.263120 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a202906b-ff85-49e6-9de1-4bd2832023fe tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:40.281321 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.wsgi [None req-a202906b-ff85-49e6-9de1-4bd2832023fe tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] HTTP exception thrown: Instance 7d2de5a1-7ae9-4010-a7fc-5d2f45212418 could not be found. Sep 23 15:25:40.282997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a202906b-ff85-49e6-9de1-4bd2832023fe tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Request method failure captured: Sep 23 15:25:40.282997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: request: GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 HTTP/1.1 Sep 23 15:25:40.282997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept: application/json Sep 23 15:25:40.282997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept-Encoding: identity Sep 23 15:25:40.282997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Connection: close Sep 23 15:25:40.282997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Length: 0 Sep 23 15:25:40.282997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Type: application/json Sep 23 15:25:40.282997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Host: 10.222.0.55 Sep 23 15:25:40.282997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Openstack-System-Scope: None Sep 23 15:25:40.282997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: User-Agent: python-urllib3/1.26.12 Sep 23 15:25:40.282997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Auth-Token: gAAAAABjLc6x1LAOulyIycgRWUTc_jBmYLdDkQeiPfEhd77MBPxxixMXuHzzzsoTpzWc9k5txbSC3yFLrYFV49oF9-wag1dL88k2AX-bXsZGWgKX7IVmHTshTzZJzO_SpP3I_fgqCNWPxP9LPw1RpnK99IMWBDohTuycUChJ76IguAfj1MEZ7Hw Sep 23 15:25:40.282997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Id: None Sep 23 15:25:40.282997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Name: None Sep 23 15:25:40.282997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Identity-Status: Confirmed Sep 23 15:25:40.282997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Is-Admin-Project: True Sep 23 15:25:40.282997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Id: default Sep 23 15:25:40.282997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Name: Default Sep 23 15:25:40.282997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Id: a079aa0c75bf44619342f53006d88ff9 Sep 23 15:25:40.282997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-717875198 Sep 23 15:25:40.282997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Role: reader,member Sep 23 15:25:40.282997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Roles: reader,member Sep 23 15:25:40.284583 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a079aa0c75bf44619342f53006d88ff9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a079aa0c75bf44619342f53006d88ff9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a079aa0c75bf44619342f53006d88ff9", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a079aa0c75bf44619342f53006d88ff9"}]}] Sep 23 15:25:40.284583 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant: tempest-ServerRescueNegativeTestJSON-717875198 Sep 23 15:25:40.284583 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Id: a079aa0c75bf44619342f53006d88ff9 Sep 23 15:25:40.284583 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-717875198 Sep 23 15:25:40.284583 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User: tempest-ServerRescueNegativeTestJSON-717875198-project Sep 23 15:25:40.284583 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Id: default Sep 23 15:25:40.284583 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Name: Default Sep 23 15:25:40.284583 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Id: a5514abdc8b54282901367a4f2d02856 Sep 23 15:25:40.284583 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Name: tempest-ServerRescueNegativeTestJSON-717875198-project Sep 23 15:25:40.284583 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: method: > Sep 23 15:25:40.284583 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: exception: Instance 7d2de5a1-7ae9-4010-a7fc-5d2f45212418 could not be found. Sep 23 15:25:40.284583 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: action_args: {'id': '7d2de5a1-7ae9-4010-a7fc-5d2f45212418'} Sep 23 15:25:40.285430 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:25:40.285430 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:25:40.285430 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:25:40.285430 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:25:40.285430 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:25:40.285430 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:25:40.285430 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:25:40.285430 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:25:40.285430 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:25:40.285430 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:25:40.285430 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d2de5a1-7ae9-4010-a7fc-5d2f45212418 could not be found. Sep 23 15:25:40.285430 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:25:40.285430 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:25:40.285430 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:25:40.285430 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:25:40.285430 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:25:40.285430 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:25:40.285430 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:25:40.285430 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:25:40.285430 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:25:40.286618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:25:40.286618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:25:40.286618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:25:40.286618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:25:40.286618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:25:40.286618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:25:40.286618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:25:40.286618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d2de5a1-7ae9-4010-a7fc-5d2f45212418 could not be found. Sep 23 15:25:40.286618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:25:40.286618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:25:40.286618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:25:40.286618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:25:40.286618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:25:40.286618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:25:40.286618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:25:40.286618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:25:40.286618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d2de5a1-7ae9-4010-a7fc-5d2f45212418 could not be found. Sep 23 15:25:40.286618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:25:40.287713 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a202906b-ff85-49e6-9de1-4bd2832023fe tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Returning 404 to user: Instance 7d2de5a1-7ae9-4010-a7fc-5d2f45212418 could not be found. {{(pid=121448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:25:40.287713 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-a202906b-ff85-49e6-9de1-4bd2832023fe tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418" status: 404 len: 111 microversion: 2.1 time: 0.036742 Sep 23 15:25:40.287713 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 325/664] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:40 2022] GET /compute/v2.1/servers/7d2de5a1-7ae9-4010-a7fc-5d2f45212418 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:25:40.295566 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-6ba4c9e1-558d-4e8b-9283-645f885dbfd7 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '.version_select at 0x7f82dbb63160>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:40.445767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-6ba4c9e1-558d-4e8b-9283-645f885dbfd7 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724063594" status: 202 len: 0 microversion: 2.1 time: 0.155911 Sep 23 15:25:40.446611 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 340/665] 10.222.0.55 () {58 vars in 1221 bytes} [Fri Sep 23 15:25:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724063594 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:25:40.848336 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-c38af89f-6050-4549-a8e0-bf271502f8af tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1051817497", "imageRef": "051c4746-7f50-4edb-b09d-a8935df360de", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b3f7a81d-77e4-45ed-aa33-730087d69ce7"}], "security_groups": [{"name": "tempest-securitygroup--778145526"}], "key_name": "tempest-keypair-631336205", "user_data": "}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:25:40.962181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.network.neutron [None req-c38af89f-6050-4549-a8e0-bf271502f8af tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] validate_networks() for [('b3f7a81d-77e4-45ed-aa33-730087d69ce7', None, None, None, None, None)] {{(pid=121448) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:25:41.620549 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-c38af89f-6050-4549-a8e0-bf271502f8af tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Flavor limits 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:25:41.621137 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-c38af89f-6050-4549-a8e0-bf271502f8af tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Image limits 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:25:41.621442 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-c38af89f-6050-4549-a8e0-bf271502f8af tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Flavor pref 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:25:41.621890 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-c38af89f-6050-4549-a8e0-bf271502f8af tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Image pref 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:25:41.622301 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-c38af89f-6050-4549-a8e0-bf271502f8af tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:25:41.631408 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c38af89f-6050-4549-a8e0-bf271502f8af tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:41.631893 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c38af89f-6050-4549-a8e0-bf271502f8af tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:41.632359 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c38af89f-6050-4549-a8e0-bf271502f8af tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:41.633091 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c38af89f-6050-4549-a8e0-bf271502f8af tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:41.633545 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c38af89f-6050-4549-a8e0-bf271502f8af tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:41.633971 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c38af89f-6050-4549-a8e0-bf271502f8af tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:41.654580 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-c38af89f-6050-4549-a8e0-bf271502f8af tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Getting quotas for project ab19e9f7cb0e49548a9ab74b9d2b4aec. Resources: {'ram', 'instances', 'cores'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:25:41.658561 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-c38af89f-6050-4549-a8e0-bf271502f8af tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Getting quotas for user f5f0ecaf38e74c96bc439fde75d93d37 and project ab19e9f7cb0e49548a9ab74b9d2b4aec. Resources: {'ram', 'instances', 'cores'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:25:41.669722 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-c38af89f-6050-4549-a8e0-bf271502f8af tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Going to run 1 instances... {{(pid=121448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:25:41.672052 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-c38af89f-6050-4549-a8e0-bf271502f8af tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='051c4746-7f50-4edb-b09d-a8935df360de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:25:41.816213 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-c38af89f-6050-4549-a8e0-bf271502f8af tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.972455 Sep 23 15:25:41.816787 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 326/666] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Sep 23 15:25:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:25:41.828556 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-cdbf3097-25c2-4741-b6cf-1b9f2a0a1cef tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:41.829275 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-cdbf3097-25c2-4741-b6cf-1b9f2a0a1cef tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:41.888868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-cdbf3097-25c2-4741-b6cf-1b9f2a0a1cef tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:41.904959 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-cdbf3097-25c2-4741-b6cf-1b9f2a0a1cef tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c" status: 200 len: 1237 microversion: 2.1 time: 0.080787 Sep 23 15:25:41.905833 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 341/667] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:41 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c => generated 1237 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:42.930640 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-e6b7724a-1846-4684-87c6-32b271d74a95 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:42.931166 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-e6b7724a-1846-4684-87c6-32b271d74a95 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:42.988448 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-e6b7724a-1846-4684-87c6-32b271d74a95 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:42.996969 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-e6b7724a-1846-4684-87c6-32b271d74a95 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c" status: 200 len: 1237 microversion: 2.1 time: 0.069688 Sep 23 15:25:42.997554 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 327/668] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:42 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:44.021685 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-72840509-a6e4-4c21-90a4-dfdab0bc609e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:44.022368 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-72840509-a6e4-4c21-90a4-dfdab0bc609e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:44.029773 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-72840509-a6e4-4c21-90a4-dfdab0bc609e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:44.030273 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-72840509-a6e4-4c21-90a4-dfdab0bc609e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:44.030709 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-72840509-a6e4-4c21-90a4-dfdab0bc609e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:44.031467 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-72840509-a6e4-4c21-90a4-dfdab0bc609e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:44.032026 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-72840509-a6e4-4c21-90a4-dfdab0bc609e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:44.032430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-72840509-a6e4-4c21-90a4-dfdab0bc609e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:44.060178 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:44.066392 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-fe9fd01d-0c0b-4555-b0df-a84cd6c7ae7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:44.073185 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-fe9fd01d-0c0b-4555-b0df-a84cd6c7ae7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:44.074783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fe9fd01d-0c0b-4555-b0df-a84cd6c7ae7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:44.075583 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fe9fd01d-0c0b-4555-b0df-a84cd6c7ae7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:44.076301 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fe9fd01d-0c0b-4555-b0df-a84cd6c7ae7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:44.077418 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fe9fd01d-0c0b-4555-b0df-a84cd6c7ae7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:44.078110 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fe9fd01d-0c0b-4555-b0df-a84cd6c7ae7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:44.078745 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fe9fd01d-0c0b-4555-b0df-a84cd6c7ae7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:44.104491 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-fe9fd01d-0c0b-4555-b0df-a84cd6c7ae7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Going to try to terminate instance {{(pid=121448) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:25:44.108558 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-72840509-a6e4-4c21-90a4-dfdab0bc609e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:44.116379 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-72840509-a6e4-4c21-90a4-dfdab0bc609e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c" status: 200 len: 1289 microversion: 2.1 time: 0.098967 Sep 23 15:25:44.116966 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 342/669] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:44 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c => generated 1289 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:44.409866 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:44.515189 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-fe9fd01d-0c0b-4555-b0df-a84cd6c7ae7c tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 204 len: 0 microversion: 2.1 time: 0.452462 Sep 23 15:25:44.515770 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 328/670] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Sep 23 15:25:44 2022] DELETE /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 15:25:44.524143 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-68f2d818-529a-4d94-9839-c84d73d49709 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:44.524796 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-68f2d818-529a-4d94-9839-c84d73d49709 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:44.532286 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-68f2d818-529a-4d94-9839-c84d73d49709 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:44.532755 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-68f2d818-529a-4d94-9839-c84d73d49709 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:44.533185 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-68f2d818-529a-4d94-9839-c84d73d49709 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:44.533863 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-68f2d818-529a-4d94-9839-c84d73d49709 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:44.534312 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-68f2d818-529a-4d94-9839-c84d73d49709 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:44.534725 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-68f2d818-529a-4d94-9839-c84d73d49709 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:44.671310 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-68f2d818-529a-4d94-9839-c84d73d49709 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:44.678920 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-68f2d818-529a-4d94-9839-c84d73d49709 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1509 microversion: 2.1 time: 0.158727 Sep 23 15:25:44.679495 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 343/671] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:44 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:45.143048 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-5ae77238-89ae-4f7a-973d-c93c7816e7b4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:45.143691 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-5ae77238-89ae-4f7a-973d-c93c7816e7b4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:45.150610 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5ae77238-89ae-4f7a-973d-c93c7816e7b4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:45.151104 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5ae77238-89ae-4f7a-973d-c93c7816e7b4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:45.151549 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5ae77238-89ae-4f7a-973d-c93c7816e7b4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:45.152396 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5ae77238-89ae-4f7a-973d-c93c7816e7b4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:45.153662 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5ae77238-89ae-4f7a-973d-c93c7816e7b4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:45.154116 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5ae77238-89ae-4f7a-973d-c93c7816e7b4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:45.219463 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-5ae77238-89ae-4f7a-973d-c93c7816e7b4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:45.227095 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-5ae77238-89ae-4f7a-973d-c93c7816e7b4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c" status: 200 len: 1297 microversion: 2.1 time: 0.088764 Sep 23 15:25:45.227660 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 329/672] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:45 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c => generated 1297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:45.701901 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-fb0b751f-93c5-4bf8-aaa5-c2a3524793eb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:45.702510 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-fb0b751f-93c5-4bf8-aaa5-c2a3524793eb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:45.709399 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fb0b751f-93c5-4bf8-aaa5-c2a3524793eb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:45.709871 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fb0b751f-93c5-4bf8-aaa5-c2a3524793eb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:45.710584 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fb0b751f-93c5-4bf8-aaa5-c2a3524793eb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:45.711517 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fb0b751f-93c5-4bf8-aaa5-c2a3524793eb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:45.711956 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fb0b751f-93c5-4bf8-aaa5-c2a3524793eb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:45.712690 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fb0b751f-93c5-4bf8-aaa5-c2a3524793eb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:45.847669 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-fb0b751f-93c5-4bf8-aaa5-c2a3524793eb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:45.855535 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-fb0b751f-93c5-4bf8-aaa5-c2a3524793eb tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1509 microversion: 2.1 time: 0.157618 Sep 23 15:25:45.856124 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 344/673] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:45 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:46.250624 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-2979fdec-bba0-4262-aebd-afe6e42aea5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:46.251233 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-2979fdec-bba0-4262-aebd-afe6e42aea5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:46.257761 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2979fdec-bba0-4262-aebd-afe6e42aea5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:46.258240 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2979fdec-bba0-4262-aebd-afe6e42aea5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:46.258701 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2979fdec-bba0-4262-aebd-afe6e42aea5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:46.259373 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2979fdec-bba0-4262-aebd-afe6e42aea5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:46.259846 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2979fdec-bba0-4262-aebd-afe6e42aea5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:46.260289 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2979fdec-bba0-4262-aebd-afe6e42aea5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:46.326645 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-2979fdec-bba0-4262-aebd-afe6e42aea5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:46.330397 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-2979fdec-bba0-4262-aebd-afe6e42aea5e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c" status: 200 len: 1297 microversion: 2.1 time: 0.083968 Sep 23 15:25:46.330968 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 330/674] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:46 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c => generated 1297 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:46.880098 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-f84aeea1-fe38-4571-be10-5afcd8567be4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:46.880673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-f84aeea1-fe38-4571-be10-5afcd8567be4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:46.887313 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f84aeea1-fe38-4571-be10-5afcd8567be4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:46.887799 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f84aeea1-fe38-4571-be10-5afcd8567be4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:46.888459 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f84aeea1-fe38-4571-be10-5afcd8567be4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:46.889296 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f84aeea1-fe38-4571-be10-5afcd8567be4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:46.889612 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f84aeea1-fe38-4571-be10-5afcd8567be4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:46.890034 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f84aeea1-fe38-4571-be10-5afcd8567be4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:47.075829 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-f84aeea1-fe38-4571-be10-5afcd8567be4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:47.085674 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-f84aeea1-fe38-4571-be10-5afcd8567be4 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1509 microversion: 2.1 time: 0.209583 Sep 23 15:25:47.086261 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 345/675] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:46 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1509 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:47.355186 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-59e070fd-de62-4f46-b1a6-e4b8344f0bc6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:47.358987 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-59e070fd-de62-4f46-b1a6-e4b8344f0bc6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:47.364238 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-59e070fd-de62-4f46-b1a6-e4b8344f0bc6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:47.364734 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-59e070fd-de62-4f46-b1a6-e4b8344f0bc6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:47.365228 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-59e070fd-de62-4f46-b1a6-e4b8344f0bc6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:47.365993 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-59e070fd-de62-4f46-b1a6-e4b8344f0bc6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:47.366465 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-59e070fd-de62-4f46-b1a6-e4b8344f0bc6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:47.366898 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-59e070fd-de62-4f46-b1a6-e4b8344f0bc6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:47.371964 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:47.440654 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-59e070fd-de62-4f46-b1a6-e4b8344f0bc6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:47.456059 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-59e070fd-de62-4f46-b1a6-e4b8344f0bc6 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c" status: 200 len: 1297 microversion: 2.1 time: 0.098055 Sep 23 15:25:47.456059 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 331/676] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:47 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c => generated 1297 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:48.104931 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-faa3d477-183b-4b43-a0cb-6d1b440f7e94 req-c436c6b3-4099-4972-8d40-c5e114e73a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e7c6dbd-a4f4-4fd8-a719-38705c323809", "name": "network-vif-deleted", "tag": "d891c01a-6a8c-4f04-ae61-1c13c3cb2ed1"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:25:48.108839 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-51df8087-1b0c-4e05-88ee-b55d023e7c6e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:48.119364 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-51df8087-1b0c-4e05-88ee-b55d023e7c6e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:48.119519 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-faa3d477-183b-4b43-a0cb-6d1b440f7e94 req-c436c6b3-4099-4972-8d40-c5e114e73a06 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:48.119641 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-51df8087-1b0c-4e05-88ee-b55d023e7c6e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:48.119744 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-faa3d477-183b-4b43-a0cb-6d1b440f7e94 req-c436c6b3-4099-4972-8d40-c5e114e73a06 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:48.119838 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-51df8087-1b0c-4e05-88ee-b55d023e7c6e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:48.119944 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-faa3d477-183b-4b43-a0cb-6d1b440f7e94 req-c436c6b3-4099-4972-8d40-c5e114e73a06 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:48.120077 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-51df8087-1b0c-4e05-88ee-b55d023e7c6e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:48.120077 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-51df8087-1b0c-4e05-88ee-b55d023e7c6e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:48.120077 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-51df8087-1b0c-4e05-88ee-b55d023e7c6e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:48.120077 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-51df8087-1b0c-4e05-88ee-b55d023e7c6e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:48.128749 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-faa3d477-183b-4b43-a0cb-6d1b440f7e94 req-c436c6b3-4099-4972-8d40-c5e114e73a06 service nova] Creating event network-vif-deleted:d891c01a-6a8c-4f04-ae61-1c13c3cb2ed1 for instance 3e7c6dbd-a4f4-4fd8-a719-38705c323809 on hv-cinder-85530 Sep 23 15:25:48.133833 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-faa3d477-183b-4b43-a0cb-6d1b440f7e94 req-c436c6b3-4099-4972-8d40-c5e114e73a06 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096813 Sep 23 15:25:48.134420 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 346/677] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:25:48.185900 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-51df8087-1b0c-4e05-88ee-b55d023e7c6e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:48.193584 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-51df8087-1b0c-4e05-88ee-b55d023e7c6e tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1467 microversion: 2.1 time: 0.089380 Sep 23 15:25:48.198684 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 332/678] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:48 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1467 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:48.479094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-71abd640-d83a-4ca9-91e6-ef6b9371022c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:48.482270 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-71abd640-d83a-4ca9-91e6-ef6b9371022c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:48.490410 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-71abd640-d83a-4ca9-91e6-ef6b9371022c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:48.491374 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-71abd640-d83a-4ca9-91e6-ef6b9371022c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:48.491899 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-71abd640-d83a-4ca9-91e6-ef6b9371022c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:48.506651 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-71abd640-d83a-4ca9-91e6-ef6b9371022c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:48.507148 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-71abd640-d83a-4ca9-91e6-ef6b9371022c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:48.507585 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-71abd640-d83a-4ca9-91e6-ef6b9371022c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:48.774728 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-71abd640-d83a-4ca9-91e6-ef6b9371022c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:48.784817 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-71abd640-d83a-4ca9-91e6-ef6b9371022c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c" status: 200 len: 1362 microversion: 2.1 time: 0.316875 Sep 23 15:25:48.786298 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 347/679] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:48 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c => generated 1362 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:49.218350 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-f74ddaee-8863-44a0-a0f6-70ad02b223d0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:49.219053 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-f74ddaee-8863-44a0-a0f6-70ad02b223d0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:49.226035 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f74ddaee-8863-44a0-a0f6-70ad02b223d0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:49.226602 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f74ddaee-8863-44a0-a0f6-70ad02b223d0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:49.227112 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f74ddaee-8863-44a0-a0f6-70ad02b223d0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:49.227819 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f74ddaee-8863-44a0-a0f6-70ad02b223d0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:49.228305 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f74ddaee-8863-44a0-a0f6-70ad02b223d0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:49.228734 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f74ddaee-8863-44a0-a0f6-70ad02b223d0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:49.262675 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f74ddaee-8863-44a0-a0f6-70ad02b223d0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:49.263794 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f74ddaee-8863-44a0-a0f6-70ad02b223d0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:49.264262 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f74ddaee-8863-44a0-a0f6-70ad02b223d0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:49.264718 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.objects.instance [None req-f74ddaee-8863-44a0-a0f6-70ad02b223d0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lazy-loading 'fault' on Instance uuid 3e7c6dbd-a4f4-4fd8-a719-38705c323809 {{(pid=121448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:25:49.306067 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-f74ddaee-8863-44a0-a0f6-70ad02b223d0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:49.314632 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-f74ddaee-8863-44a0-a0f6-70ad02b223d0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 200 len: 1312 microversion: 2.1 time: 0.101142 Sep 23 15:25:49.315217 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 333/680] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:49 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:49.811421 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-5b797183-4039-4f18-a2d3-2e42245f3c97 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:49.812061 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-5b797183-4039-4f18-a2d3-2e42245f3c97 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:49.819030 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5b797183-4039-4f18-a2d3-2e42245f3c97 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:49.819520 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5b797183-4039-4f18-a2d3-2e42245f3c97 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:49.819963 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5b797183-4039-4f18-a2d3-2e42245f3c97 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:49.820687 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5b797183-4039-4f18-a2d3-2e42245f3c97 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:49.821171 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5b797183-4039-4f18-a2d3-2e42245f3c97 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:49.821594 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5b797183-4039-4f18-a2d3-2e42245f3c97 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:50.068338 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-5b797183-4039-4f18-a2d3-2e42245f3c97 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:50.076521 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-5b797183-4039-4f18-a2d3-2e42245f3c97 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c" status: 200 len: 1362 microversion: 2.1 time: 0.269645 Sep 23 15:25:50.077292 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 348/681] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:49 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:50.156432 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-7d7bd25c-7663-4286-9b18-b18860c87864 req-0e6b37be-f369-4f17-b725-9b642e3d15b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f41b2c1-177e-47f5-b7d5-48166096714c", "tag": "55436e11-cb4f-4c3c-ab14-4385e7710520"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:25:50.166346 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-7d7bd25c-7663-4286-9b18-b18860c87864 req-0e6b37be-f369-4f17-b725-9b642e3d15b3 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:50.166886 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-7d7bd25c-7663-4286-9b18-b18860c87864 req-0e6b37be-f369-4f17-b725-9b642e3d15b3 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:50.167231 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-7d7bd25c-7663-4286-9b18-b18860c87864 req-0e6b37be-f369-4f17-b725-9b642e3d15b3 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:50.186435 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-7d7bd25c-7663-4286-9b18-b18860c87864 req-0e6b37be-f369-4f17-b725-9b642e3d15b3 service nova] Creating event network-changed:55436e11-cb4f-4c3c-ab14-4385e7710520 for instance 3f41b2c1-177e-47f5-b7d5-48166096714c on hv-cinder-85530 Sep 23 15:25:50.191578 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-7d7bd25c-7663-4286-9b18-b18860c87864 req-0e6b37be-f369-4f17-b725-9b642e3d15b3 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039579 Sep 23 15:25:50.192244 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 334/682] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:25:50.338560 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a33ccab5-2c8a-445e-b794-99094f31214b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:50.339099 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-a33ccab5-2c8a-445e-b794-99094f31214b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 3e7c6dbd-a4f4-4fd8-a719-38705c323809] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:50.345780 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a33ccab5-2c8a-445e-b794-99094f31214b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:50.346357 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a33ccab5-2c8a-445e-b794-99094f31214b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:50.346693 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a33ccab5-2c8a-445e-b794-99094f31214b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:50.347383 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a33ccab5-2c8a-445e-b794-99094f31214b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:50.347834 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a33ccab5-2c8a-445e-b794-99094f31214b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:50.348374 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a33ccab5-2c8a-445e-b794-99094f31214b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:50.362802 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-a33ccab5-2c8a-445e-b794-99094f31214b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] HTTP exception thrown: Instance 3e7c6dbd-a4f4-4fd8-a719-38705c323809 could not be found. Sep 23 15:25:50.364484 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a33ccab5-2c8a-445e-b794-99094f31214b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Request method failure captured: Sep 23 15:25:50.364484 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 HTTP/1.1 Sep 23 15:25:50.364484 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:25:50.364484 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:25:50.364484 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:25:50.364484 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:25:50.364484 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:25:50.364484 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:25:50.364484 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:25:50.364484 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:25:50.364484 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLc6x1LAOulyIycgRWUTc_jBmYLdDkQeiPfEhd77MBPxxixMXuHzzzsoTpzWc9k5txbSC3yFLrYFV49oF9-wag1dL88k2AX-bXsZGWgKX7IVmHTshTzZJzO_SpP3I_fgqCNWPxP9LPw1RpnK99IMWBDohTuycUChJ76IguAfj1MEZ7Hw Sep 23 15:25:50.364484 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:25:50.364484 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:25:50.364484 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:25:50.364484 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:25:50.364484 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:25:50.364484 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:25:50.364484 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: a079aa0c75bf44619342f53006d88ff9 Sep 23 15:25:50.364484 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-717875198 Sep 23 15:25:50.364484 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:25:50.364484 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:25:50.366227 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a079aa0c75bf44619342f53006d88ff9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a079aa0c75bf44619342f53006d88ff9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a079aa0c75bf44619342f53006d88ff9", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a079aa0c75bf44619342f53006d88ff9"}]}] Sep 23 15:25:50.366227 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-ServerRescueNegativeTestJSON-717875198 Sep 23 15:25:50.366227 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: a079aa0c75bf44619342f53006d88ff9 Sep 23 15:25:50.366227 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-717875198 Sep 23 15:25:50.366227 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-ServerRescueNegativeTestJSON-717875198-project Sep 23 15:25:50.366227 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:25:50.366227 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:25:50.366227 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: a5514abdc8b54282901367a4f2d02856 Sep 23 15:25:50.366227 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-ServerRescueNegativeTestJSON-717875198-project Sep 23 15:25:50.366227 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:25:50.366227 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance 3e7c6dbd-a4f4-4fd8-a719-38705c323809 could not be found. Sep 23 15:25:50.366227 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '3e7c6dbd-a4f4-4fd8-a719-38705c323809'} Sep 23 15:25:50.367592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:25:50.367592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:25:50.367592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:25:50.367592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:25:50.367592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:25:50.367592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:25:50.367592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:25:50.367592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:25:50.367592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:25:50.367592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:25:50.367592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e7c6dbd-a4f4-4fd8-a719-38705c323809 could not be found. Sep 23 15:25:50.367592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:25:50.367592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:25:50.367592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:25:50.367592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:25:50.367592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:25:50.367592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:25:50.367592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:25:50.367592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:25:50.367592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:25:50.369861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:25:50.369861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:25:50.369861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:25:50.369861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:25:50.369861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:25:50.369861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:25:50.369861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:25:50.369861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e7c6dbd-a4f4-4fd8-a719-38705c323809 could not be found. Sep 23 15:25:50.369861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:25:50.369861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:25:50.369861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:25:50.369861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:25:50.369861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:25:50.369861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:25:50.369861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:25:50.369861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:25:50.369861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e7c6dbd-a4f4-4fd8-a719-38705c323809 could not be found. Sep 23 15:25:50.369861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:25:50.371196 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a33ccab5-2c8a-445e-b794-99094f31214b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Returning 404 to user: Instance 3e7c6dbd-a4f4-4fd8-a719-38705c323809 could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:25:50.371196 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-a33ccab5-2c8a-445e-b794-99094f31214b tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809" status: 404 len: 111 microversion: 2.1 time: 0.031281 Sep 23 15:25:50.371196 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 349/683] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:50 2022] GET /compute/v2.1/servers/3e7c6dbd-a4f4-4fd8-a719-38705c323809 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:25:50.375883 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-608b4065-d14e-436d-9622-c72a41bf7b3f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:50.376507 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-608b4065-d14e-436d-9622-c72a41bf7b3f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:50.382684 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-608b4065-d14e-436d-9622-c72a41bf7b3f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:50.383367 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-608b4065-d14e-436d-9622-c72a41bf7b3f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:50.383806 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-608b4065-d14e-436d-9622-c72a41bf7b3f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:50.384581 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-608b4065-d14e-436d-9622-c72a41bf7b3f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:50.385034 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-608b4065-d14e-436d-9622-c72a41bf7b3f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:50.385505 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-608b4065-d14e-436d-9622-c72a41bf7b3f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:50.411183 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-608b4065-d14e-436d-9622-c72a41bf7b3f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Going to try to terminate instance {{(pid=121448) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:25:50.820831 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-608b4065-d14e-436d-9622-c72a41bf7b3f tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "DELETE /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 204 len: 0 microversion: 2.1 time: 0.449565 Sep 23 15:25:50.821424 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 335/684] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Sep 23 15:25:50 2022] DELETE /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 15:25:50.829428 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-73135350-ec2a-48e8-ac59-716fb64a5193 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:50.830033 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-73135350-ec2a-48e8-ac59-716fb64a5193 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:50.836460 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-73135350-ec2a-48e8-ac59-716fb64a5193 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:50.838530 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-73135350-ec2a-48e8-ac59-716fb64a5193 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:50.838530 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-73135350-ec2a-48e8-ac59-716fb64a5193 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:50.838530 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-73135350-ec2a-48e8-ac59-716fb64a5193 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:50.838530 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-73135350-ec2a-48e8-ac59-716fb64a5193 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:50.838930 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-73135350-ec2a-48e8-ac59-716fb64a5193 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:50.971052 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-73135350-ec2a-48e8-ac59-716fb64a5193 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:50.978817 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-73135350-ec2a-48e8-ac59-716fb64a5193 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 200 len: 1522 microversion: 2.1 time: 0.153295 Sep 23 15:25:50.980387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 350/685] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:50 2022] GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:51.101385 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-80c3cb1a-fa32-4985-bb09-c85119b8fba9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:51.102143 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-80c3cb1a-fa32-4985-bb09-c85119b8fba9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:51.109259 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-80c3cb1a-fa32-4985-bb09-c85119b8fba9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:51.113660 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-80c3cb1a-fa32-4985-bb09-c85119b8fba9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:51.113660 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-80c3cb1a-fa32-4985-bb09-c85119b8fba9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:51.113660 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-80c3cb1a-fa32-4985-bb09-c85119b8fba9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:51.113660 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-80c3cb1a-fa32-4985-bb09-c85119b8fba9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:51.114054 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-80c3cb1a-fa32-4985-bb09-c85119b8fba9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:51.248560 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-80c3cb1a-fa32-4985-bb09-c85119b8fba9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:51.257940 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-80c3cb1a-fa32-4985-bb09-c85119b8fba9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c" status: 200 len: 1362 microversion: 2.1 time: 0.161269 Sep 23 15:25:51.258530 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 336/686] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:51 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:52.004259 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-e6e15a48-c900-4707-ba34-406504e8b34d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:52.005056 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-e6e15a48-c900-4707-ba34-406504e8b34d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:52.011464 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell0:SELECT=6 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:52.015041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e6e15a48-c900-4707-ba34-406504e8b34d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:52.015647 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e6e15a48-c900-4707-ba34-406504e8b34d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:52.016340 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e6e15a48-c900-4707-ba34-406504e8b34d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:52.017510 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e6e15a48-c900-4707-ba34-406504e8b34d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:52.018138 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e6e15a48-c900-4707-ba34-406504e8b34d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:52.018712 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e6e15a48-c900-4707-ba34-406504e8b34d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:52.177922 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-e6e15a48-c900-4707-ba34-406504e8b34d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:52.185966 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-e6e15a48-c900-4707-ba34-406504e8b34d tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 200 len: 1522 microversion: 2.1 time: 0.186422 Sep 23 15:25:52.198396 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 351/687] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:51 2022] GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:52.282572 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6061c586-fc0a-416b-8826-233f932c6fdd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:52.283199 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-6061c586-fc0a-416b-8826-233f932c6fdd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:52.285675 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell0:SELECT=2 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:52.292065 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6061c586-fc0a-416b-8826-233f932c6fdd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:52.292570 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6061c586-fc0a-416b-8826-233f932c6fdd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:52.293085 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6061c586-fc0a-416b-8826-233f932c6fdd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:52.293779 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6061c586-fc0a-416b-8826-233f932c6fdd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:52.294644 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6061c586-fc0a-416b-8826-233f932c6fdd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:52.295078 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6061c586-fc0a-416b-8826-233f932c6fdd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:52.428755 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6061c586-fc0a-416b-8826-233f932c6fdd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:52.437269 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-6061c586-fc0a-416b-8826-233f932c6fdd tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c" status: 200 len: 1362 microversion: 2.1 time: 0.159397 Sep 23 15:25:52.437848 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 337/688] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:52 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:53.210310 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b12d891c-d504-4797-9fc2-7d19a92df146 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:53.211320 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-b12d891c-d504-4797-9fc2-7d19a92df146 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:53.218774 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b12d891c-d504-4797-9fc2-7d19a92df146 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:53.219306 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b12d891c-d504-4797-9fc2-7d19a92df146 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:53.219686 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b12d891c-d504-4797-9fc2-7d19a92df146 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:53.220403 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b12d891c-d504-4797-9fc2-7d19a92df146 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:53.220850 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b12d891c-d504-4797-9fc2-7d19a92df146 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:53.221270 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b12d891c-d504-4797-9fc2-7d19a92df146 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:53.221932 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-bf11c44a-dd84-4546-89aa-898f0ff3047b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:25:53.222487 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-bf11c44a-dd84-4546-89aa-898f0ff3047b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:53.224499 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell0:SELECT=8 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:53.229399 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf11c44a-dd84-4546-89aa-898f0ff3047b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:53.229883 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf11c44a-dd84-4546-89aa-898f0ff3047b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:53.230379 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf11c44a-dd84-4546-89aa-898f0ff3047b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:53.231134 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf11c44a-dd84-4546-89aa-898f0ff3047b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:53.231534 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf11c44a-dd84-4546-89aa-898f0ff3047b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:53.231959 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bf11c44a-dd84-4546-89aa-898f0ff3047b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:53.258694 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.objects.instance [None req-bf11c44a-dd84-4546-89aa-898f0ff3047b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lazy-loading 'flavor' on Instance uuid 74b48a2a-0dde-4289-b8d6-788a66dafddb {{(pid=121448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:25:53.367320 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-b12d891c-d504-4797-9fc2-7d19a92df146 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:53.375674 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-b12d891c-d504-4797-9fc2-7d19a92df146 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 200 len: 1522 microversion: 2.1 time: 0.169752 Sep 23 15:25:53.376271 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 352/689] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:53 2022] GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:53.461435 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-c69e7987-db0f-4288-9682-d0bf14086422 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:53.462059 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-c69e7987-db0f-4288-9682-d0bf14086422 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:53.468792 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c69e7987-db0f-4288-9682-d0bf14086422 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:53.469438 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c69e7987-db0f-4288-9682-d0bf14086422 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:53.469885 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c69e7987-db0f-4288-9682-d0bf14086422 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:53.470589 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c69e7987-db0f-4288-9682-d0bf14086422 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:53.471120 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c69e7987-db0f-4288-9682-d0bf14086422 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:53.471550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c69e7987-db0f-4288-9682-d0bf14086422 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:53.604259 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-c69e7987-db0f-4288-9682-d0bf14086422 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:53.612697 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-c69e7987-db0f-4288-9682-d0bf14086422 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c" status: 200 len: 1362 microversion: 2.1 time: 0.155196 Sep 23 15:25:53.613282 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 353/690] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:53 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:53.657706 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-bf11c44a-dd84-4546-89aa-898f0ff3047b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "POST /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb/action" status: 202 len: 0 microversion: 2.1 time: 0.440458 Sep 23 15:25:53.658521 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 338/691] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Sep 23 15:25:53 2022] POST /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:25:53.666691 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a8732070-828e-4de5-b171-0e902be0a816 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:53.667324 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-a8732070-828e-4de5-b171-0e902be0a816 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:53.674234 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a8732070-828e-4de5-b171-0e902be0a816 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:53.674978 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a8732070-828e-4de5-b171-0e902be0a816 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:53.675409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a8732070-828e-4de5-b171-0e902be0a816 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:53.676296 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a8732070-828e-4de5-b171-0e902be0a816 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:53.676932 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a8732070-828e-4de5-b171-0e902be0a816 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:53.677354 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a8732070-828e-4de5-b171-0e902be0a816 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:53.873257 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a8732070-828e-4de5-b171-0e902be0a816 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:53.873257 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-a8732070-828e-4de5-b171-0e902be0a816 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1569 microversion: 2.1 time: 0.173892 Sep 23 15:25:53.873257 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 354/692] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:53 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:54.402872 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-d2b71e17-7d42-4b11-b32e-06ee9c242d28 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:54.404766 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-d2b71e17-7d42-4b11-b32e-06ee9c242d28 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:54.415643 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d2b71e17-7d42-4b11-b32e-06ee9c242d28 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:54.416927 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d2b71e17-7d42-4b11-b32e-06ee9c242d28 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:54.417469 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d2b71e17-7d42-4b11-b32e-06ee9c242d28 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:54.418373 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d2b71e17-7d42-4b11-b32e-06ee9c242d28 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:54.418986 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d2b71e17-7d42-4b11-b32e-06ee9c242d28 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:54.419739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d2b71e17-7d42-4b11-b32e-06ee9c242d28 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:54.590343 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-d2b71e17-7d42-4b11-b32e-06ee9c242d28 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:54.598962 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-d2b71e17-7d42-4b11-b32e-06ee9c242d28 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 200 len: 1522 microversion: 2.1 time: 0.203314 Sep 23 15:25:54.599559 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 339/693] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:54 2022] GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:54.638963 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-5d71b11d-917f-42c6-b109-62ab5f47e14c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:54.639592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-5d71b11d-917f-42c6-b109-62ab5f47e14c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:54.651240 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5d71b11d-917f-42c6-b109-62ab5f47e14c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:54.651731 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5d71b11d-917f-42c6-b109-62ab5f47e14c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:54.652302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5d71b11d-917f-42c6-b109-62ab5f47e14c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:54.653006 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5d71b11d-917f-42c6-b109-62ab5f47e14c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:54.653460 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5d71b11d-917f-42c6-b109-62ab5f47e14c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:54.653877 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5d71b11d-917f-42c6-b109-62ab5f47e14c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:54.831020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-5d71b11d-917f-42c6-b109-62ab5f47e14c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:54.846225 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-5d71b11d-917f-42c6-b109-62ab5f47e14c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c" status: 200 len: 1362 microversion: 2.1 time: 0.212879 Sep 23 15:25:54.847290 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 355/694] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:54 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:54.862521 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-2c04a2a1-3dce-493e-9da4-8d3b2c792bbf tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:54.863706 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-2c04a2a1-3dce-493e-9da4-8d3b2c792bbf tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:54.871251 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2c04a2a1-3dce-493e-9da4-8d3b2c792bbf tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:54.871880 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2c04a2a1-3dce-493e-9da4-8d3b2c792bbf tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:54.872446 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2c04a2a1-3dce-493e-9da4-8d3b2c792bbf tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:54.873334 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2c04a2a1-3dce-493e-9da4-8d3b2c792bbf tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:54.874795 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2c04a2a1-3dce-493e-9da4-8d3b2c792bbf tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:54.875351 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2c04a2a1-3dce-493e-9da4-8d3b2c792bbf tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:54.952537 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-7ea43e86-531f-4bcb-9440-cbea9a4d98d1 req-2a451def-f349-49ff-9a46-0b8f1fe5e73a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53291dd1-3df2-438e-a2aa-80fa4e76245c", "name": "network-vif-deleted", "tag": "0ac971ff-aa73-4c23-905e-b603461ad30f"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:25:54.965473 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-7ea43e86-531f-4bcb-9440-cbea9a4d98d1 req-2a451def-f349-49ff-9a46-0b8f1fe5e73a service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:54.968352 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-7ea43e86-531f-4bcb-9440-cbea9a4d98d1 req-2a451def-f349-49ff-9a46-0b8f1fe5e73a service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:54.968352 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-7ea43e86-531f-4bcb-9440-cbea9a4d98d1 req-2a451def-f349-49ff-9a46-0b8f1fe5e73a service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:54.982801 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-7ea43e86-531f-4bcb-9440-cbea9a4d98d1 req-2a451def-f349-49ff-9a46-0b8f1fe5e73a service nova] Creating event network-vif-deleted:0ac971ff-aa73-4c23-905e-b603461ad30f for instance 53291dd1-3df2-438e-a2aa-80fa4e76245c on hv-cinder-85530 Sep 23 15:25:54.991939 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-7ea43e86-531f-4bcb-9440-cbea9a4d98d1 req-2a451def-f349-49ff-9a46-0b8f1fe5e73a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050081 Sep 23 15:25:54.992950 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 356/695] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:25:55.074203 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-2c04a2a1-3dce-493e-9da4-8d3b2c792bbf tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:55.082625 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-2c04a2a1-3dce-493e-9da4-8d3b2c792bbf tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1569 microversion: 2.1 time: 0.224475 Sep 23 15:25:55.083211 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 340/696] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:54 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1569 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:25:55.623056 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-0cc4004b-d05e-4189-a567-663b00933525 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:55.624046 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-0cc4004b-d05e-4189-a567-663b00933525 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:55.630282 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0cc4004b-d05e-4189-a567-663b00933525 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:55.630767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0cc4004b-d05e-4189-a567-663b00933525 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:55.631207 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0cc4004b-d05e-4189-a567-663b00933525 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:55.631967 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0cc4004b-d05e-4189-a567-663b00933525 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:55.632375 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0cc4004b-d05e-4189-a567-663b00933525 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:55.632799 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0cc4004b-d05e-4189-a567-663b00933525 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:55.664523 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0cc4004b-d05e-4189-a567-663b00933525 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:55.665148 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0cc4004b-d05e-4189-a567-663b00933525 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:55.665449 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0cc4004b-d05e-4189-a567-663b00933525 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:55.665887 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.objects.instance [None req-0cc4004b-d05e-4189-a567-663b00933525 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lazy-loading 'fault' on Instance uuid 53291dd1-3df2-438e-a2aa-80fa4e76245c {{(pid=121450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:25:55.712595 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-0cc4004b-d05e-4189-a567-663b00933525 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5514abdc8b54282901367a4f2d02856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a079aa0c75bf44619342f53006d88ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:55.727225 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-0cc4004b-d05e-4189-a567-663b00933525 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 200 len: 1311 microversion: 2.1 time: 0.108245 Sep 23 15:25:55.727812 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 357/697] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:55 2022] GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 1311 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:55.871134 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a8eb6f92-4ee6-4826-82b7-98d7a326662e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:55.871684 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-a8eb6f92-4ee6-4826-82b7-98d7a326662e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:55.879306 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a8eb6f92-4ee6-4826-82b7-98d7a326662e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:55.879825 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a8eb6f92-4ee6-4826-82b7-98d7a326662e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:55.880521 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a8eb6f92-4ee6-4826-82b7-98d7a326662e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:55.881216 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a8eb6f92-4ee6-4826-82b7-98d7a326662e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:55.881678 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a8eb6f92-4ee6-4826-82b7-98d7a326662e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:55.882106 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a8eb6f92-4ee6-4826-82b7-98d7a326662e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:56.016177 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a8eb6f92-4ee6-4826-82b7-98d7a326662e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:56.023805 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-a8eb6f92-4ee6-4826-82b7-98d7a326662e tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c" status: 200 len: 1362 microversion: 2.1 time: 0.156613 Sep 23 15:25:56.024408 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 341/698] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:55 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:56.105487 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-51010cac-a6bb-4de0-ad3a-90bfeec7653d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:56.106099 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-51010cac-a6bb-4de0-ad3a-90bfeec7653d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:56.112942 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-51010cac-a6bb-4de0-ad3a-90bfeec7653d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:56.113427 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-51010cac-a6bb-4de0-ad3a-90bfeec7653d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:56.113949 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-51010cac-a6bb-4de0-ad3a-90bfeec7653d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:56.114551 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-51010cac-a6bb-4de0-ad3a-90bfeec7653d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:56.115008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-51010cac-a6bb-4de0-ad3a-90bfeec7653d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:56.115432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-51010cac-a6bb-4de0-ad3a-90bfeec7653d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:56.255588 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-51010cac-a6bb-4de0-ad3a-90bfeec7653d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:56.263446 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-51010cac-a6bb-4de0-ad3a-90bfeec7653d tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1569 microversion: 2.1 time: 0.161859 Sep 23 15:25:56.264156 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 358/699] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:56 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:56.708479 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-bb2f7138-089d-4358-94e8-be0d2c70e209 req-e91a7d02-87f5-45d8-8bf3-5bcc9535a4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f41b2c1-177e-47f5-b7d5-48166096714c", "name": "network-vif-plugged", "status": "completed", "tag": "55436e11-cb4f-4c3c-ab14-4385e7710520"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:25:56.718857 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-bb2f7138-089d-4358-94e8-be0d2c70e209 req-e91a7d02-87f5-45d8-8bf3-5bcc9535a4f0 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:56.719849 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-bb2f7138-089d-4358-94e8-be0d2c70e209 req-e91a7d02-87f5-45d8-8bf3-5bcc9535a4f0 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:56.720426 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-bb2f7138-089d-4358-94e8-be0d2c70e209 req-e91a7d02-87f5-45d8-8bf3-5bcc9535a4f0 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:56.731892 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-bb2f7138-089d-4358-94e8-be0d2c70e209 req-e91a7d02-87f5-45d8-8bf3-5bcc9535a4f0 service nova] Creating event network-vif-plugged:55436e11-cb4f-4c3c-ab14-4385e7710520 for instance 3f41b2c1-177e-47f5-b7d5-48166096714c on hv-cinder-85530 Sep 23 15:25:56.737393 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-bb2f7138-089d-4358-94e8-be0d2c70e209 req-e91a7d02-87f5-45d8-8bf3-5bcc9535a4f0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154209 Sep 23 15:25:56.739271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 342/700] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:25:56.752463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-83825adf-c148-4f24-9108-1699af9c2fc0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:56.753079 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-83825adf-c148-4f24-9108-1699af9c2fc0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] [instance: 53291dd1-3df2-438e-a2aa-80fa4e76245c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:56.759561 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-83825adf-c148-4f24-9108-1699af9c2fc0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:56.760089 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-83825adf-c148-4f24-9108-1699af9c2fc0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:56.760532 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-83825adf-c148-4f24-9108-1699af9c2fc0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:56.761252 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-83825adf-c148-4f24-9108-1699af9c2fc0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:56.761704 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-83825adf-c148-4f24-9108-1699af9c2fc0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:56.762131 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-83825adf-c148-4f24-9108-1699af9c2fc0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:56.777428 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-83825adf-c148-4f24-9108-1699af9c2fc0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] HTTP exception thrown: Instance 53291dd1-3df2-438e-a2aa-80fa4e76245c could not be found. Sep 23 15:25:56.779123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-83825adf-c148-4f24-9108-1699af9c2fc0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Request method failure captured: Sep 23 15:25:56.779123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c HTTP/1.1 Sep 23 15:25:56.779123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:25:56.779123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:25:56.779123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:25:56.779123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:25:56.779123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:25:56.779123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:25:56.779123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:25:56.779123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:25:56.779123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLc6x1LAOulyIycgRWUTc_jBmYLdDkQeiPfEhd77MBPxxixMXuHzzzsoTpzWc9k5txbSC3yFLrYFV49oF9-wag1dL88k2AX-bXsZGWgKX7IVmHTshTzZJzO_SpP3I_fgqCNWPxP9LPw1RpnK99IMWBDohTuycUChJ76IguAfj1MEZ7Hw Sep 23 15:25:56.779123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:25:56.779123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:25:56.779123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:25:56.779123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:25:56.779123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:25:56.779123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:25:56.779123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: a079aa0c75bf44619342f53006d88ff9 Sep 23 15:25:56.779123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-717875198 Sep 23 15:25:56.779123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:25:56.779123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:25:56.781925 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a079aa0c75bf44619342f53006d88ff9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a079aa0c75bf44619342f53006d88ff9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a079aa0c75bf44619342f53006d88ff9", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a079aa0c75bf44619342f53006d88ff9"}]}] Sep 23 15:25:56.781925 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-ServerRescueNegativeTestJSON-717875198 Sep 23 15:25:56.781925 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: a079aa0c75bf44619342f53006d88ff9 Sep 23 15:25:56.781925 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-717875198 Sep 23 15:25:56.781925 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-ServerRescueNegativeTestJSON-717875198-project Sep 23 15:25:56.781925 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:25:56.781925 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:25:56.781925 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: a5514abdc8b54282901367a4f2d02856 Sep 23 15:25:56.781925 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-ServerRescueNegativeTestJSON-717875198-project Sep 23 15:25:56.781925 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:25:56.781925 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance 53291dd1-3df2-438e-a2aa-80fa4e76245c could not be found. Sep 23 15:25:56.781925 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '53291dd1-3df2-438e-a2aa-80fa4e76245c'} Sep 23 15:25:56.782868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:25:56.782868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:25:56.782868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:25:56.782868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:25:56.782868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:25:56.782868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:25:56.782868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:25:56.782868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:25:56.782868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:25:56.782868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:25:56.782868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53291dd1-3df2-438e-a2aa-80fa4e76245c could not be found. Sep 23 15:25:56.782868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:25:56.782868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:25:56.782868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:25:56.782868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:25:56.782868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:25:56.782868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:25:56.782868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:25:56.782868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:25:56.782868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:25:56.784338 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:25:56.784338 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:25:56.784338 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:25:56.784338 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:25:56.784338 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:25:56.784338 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:25:56.784338 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:25:56.784338 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53291dd1-3df2-438e-a2aa-80fa4e76245c could not be found. Sep 23 15:25:56.784338 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:25:56.784338 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:25:56.784338 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:25:56.784338 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:25:56.784338 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:25:56.784338 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:25:56.784338 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:25:56.784338 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:25:56.784338 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53291dd1-3df2-438e-a2aa-80fa4e76245c could not be found. Sep 23 15:25:56.784338 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:25:56.785650 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-83825adf-c148-4f24-9108-1699af9c2fc0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] Returning 404 to user: Instance 53291dd1-3df2-438e-a2aa-80fa4e76245c could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:25:56.785650 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-83825adf-c148-4f24-9108-1699af9c2fc0 tempest-ServerRescueNegativeTestJSON-717875198 tempest-ServerRescueNegativeTestJSON-717875198-project] 10.222.0.55 "GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c" status: 404 len: 111 microversion: 2.1 time: 0.032408 Sep 23 15:25:56.785650 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 359/701] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:56 2022] GET /compute/v2.1/servers/53291dd1-3df2-438e-a2aa-80fa4e76245c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:25:57.049216 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-4f992b90-f668-4a58-8ddf-cc874de1f292 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:57.052891 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-4f992b90-f668-4a58-8ddf-cc874de1f292 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:57.059134 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4f992b90-f668-4a58-8ddf-cc874de1f292 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:57.059632 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4f992b90-f668-4a58-8ddf-cc874de1f292 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:57.060101 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4f992b90-f668-4a58-8ddf-cc874de1f292 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:57.074661 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4f992b90-f668-4a58-8ddf-cc874de1f292 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:57.075057 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4f992b90-f668-4a58-8ddf-cc874de1f292 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:57.075499 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4f992b90-f668-4a58-8ddf-cc874de1f292 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:57.287782 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-79cedba4-0b15-4f10-a15c-64d52db2664e tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:57.288697 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-79cedba4-0b15-4f10-a15c-64d52db2664e tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:57.298369 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-79cedba4-0b15-4f10-a15c-64d52db2664e tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:57.298905 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-79cedba4-0b15-4f10-a15c-64d52db2664e tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:57.299352 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-79cedba4-0b15-4f10-a15c-64d52db2664e tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:57.300099 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-79cedba4-0b15-4f10-a15c-64d52db2664e tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:57.300557 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-79cedba4-0b15-4f10-a15c-64d52db2664e tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:57.300978 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-79cedba4-0b15-4f10-a15c-64d52db2664e tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:57.360778 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-4f992b90-f668-4a58-8ddf-cc874de1f292 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:57.370550 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-4f992b90-f668-4a58-8ddf-cc874de1f292 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c" status: 200 len: 1362 microversion: 2.1 time: 0.326120 Sep 23 15:25:57.382368 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 343/702] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:57 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:57.439327 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-79cedba4-0b15-4f10-a15c-64d52db2664e tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:57.447357 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-79cedba4-0b15-4f10-a15c-64d52db2664e tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1569 microversion: 2.1 time: 0.163573 Sep 23 15:25:57.447931 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 360/703] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:57 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:25:58.395529 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-eae99e64-f5d3-4de1-9f01-ffa5bd2edbd5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:58.396106 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-eae99e64-f5d3-4de1-9f01-ffa5bd2edbd5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:58.402387 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-eae99e64-f5d3-4de1-9f01-ffa5bd2edbd5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:58.402923 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-eae99e64-f5d3-4de1-9f01-ffa5bd2edbd5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:58.403360 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-eae99e64-f5d3-4de1-9f01-ffa5bd2edbd5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:58.404111 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-eae99e64-f5d3-4de1-9f01-ffa5bd2edbd5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:58.404566 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-eae99e64-f5d3-4de1-9f01-ffa5bd2edbd5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:58.404987 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-eae99e64-f5d3-4de1-9f01-ffa5bd2edbd5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:58.472823 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-f9e89aac-ade4-4180-be63-c6cc651529fd tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:58.473434 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-f9e89aac-ade4-4180-be63-c6cc651529fd tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:58.480131 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f9e89aac-ade4-4180-be63-c6cc651529fd tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:58.480608 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f9e89aac-ade4-4180-be63-c6cc651529fd tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:58.481038 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f9e89aac-ade4-4180-be63-c6cc651529fd tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:58.481743 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f9e89aac-ade4-4180-be63-c6cc651529fd tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:58.482213 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f9e89aac-ade4-4180-be63-c6cc651529fd tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:58.482627 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f9e89aac-ade4-4180-be63-c6cc651529fd tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:58.501828 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=100 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:58.595510 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-eae99e64-f5d3-4de1-9f01-ffa5bd2edbd5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:58.603884 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-eae99e64-f5d3-4de1-9f01-ffa5bd2edbd5 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c" status: 200 len: 1362 microversion: 2.1 time: 0.212173 Sep 23 15:25:58.604601 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 344/704] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:58 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:58.622972 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-f9e89aac-ade4-4180-be63-c6cc651529fd tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:58.632717 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-f9e89aac-ade4-4180-be63-c6cc651529fd tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1569 microversion: 2.1 time: 0.163734 Sep 23 15:25:58.633295 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 361/705] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:58 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:25:59.628575 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-4682b33e-e4ec-487c-b26a-101a15029648 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:59.629273 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-4682b33e-e4ec-487c-b26a-101a15029648 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:59.635761 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4682b33e-e4ec-487c-b26a-101a15029648 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:59.636286 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4682b33e-e4ec-487c-b26a-101a15029648 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:59.636735 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4682b33e-e4ec-487c-b26a-101a15029648 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:59.637443 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4682b33e-e4ec-487c-b26a-101a15029648 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:59.637904 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4682b33e-e4ec-487c-b26a-101a15029648 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:59.638342 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-4682b33e-e4ec-487c-b26a-101a15029648 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:59.643146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:59.663612 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-f69310d8-3979-4aec-b65a-3f8fdcbd2616 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:59.664369 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-f69310d8-3979-4aec-b65a-3f8fdcbd2616 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:59.675262 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f69310d8-3979-4aec-b65a-3f8fdcbd2616 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:59.675837 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f69310d8-3979-4aec-b65a-3f8fdcbd2616 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:59.676400 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f69310d8-3979-4aec-b65a-3f8fdcbd2616 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:59.677181 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f69310d8-3979-4aec-b65a-3f8fdcbd2616 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:59.677705 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f69310d8-3979-4aec-b65a-3f8fdcbd2616 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:59.678386 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f69310d8-3979-4aec-b65a-3f8fdcbd2616 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:59.818944 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-f69310d8-3979-4aec-b65a-3f8fdcbd2616 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:59.827325 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-f69310d8-3979-4aec-b65a-3f8fdcbd2616 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1569 microversion: 2.1 time: 0.168044 Sep 23 15:25:59.827894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 362/706] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:59 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:59.912183 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-4682b33e-e4ec-487c-b26a-101a15029648 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:59.920850 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-4682b33e-e4ec-487c-b26a-101a15029648 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c" status: 200 len: 1362 microversion: 2.1 time: 0.296412 Sep 23 15:25:59.930006 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 345/707] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:59 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c => generated 1362 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:00.850389 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a0818677-fd48-4e1b-9da8-08397c328903 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:00.862211 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-a0818677-fd48-4e1b-9da8-08397c328903 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:00.862211 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a0818677-fd48-4e1b-9da8-08397c328903 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:00.862211 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a0818677-fd48-4e1b-9da8-08397c328903 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:00.862211 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a0818677-fd48-4e1b-9da8-08397c328903 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:00.862702 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a0818677-fd48-4e1b-9da8-08397c328903 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:00.862702 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a0818677-fd48-4e1b-9da8-08397c328903 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:00.862702 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a0818677-fd48-4e1b-9da8-08397c328903 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:00.944819 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6898894f-21c9-4e97-8fa0-dc244fd9dda7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:00.945433 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-6898894f-21c9-4e97-8fa0-dc244fd9dda7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:00.952170 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6898894f-21c9-4e97-8fa0-dc244fd9dda7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:00.952671 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6898894f-21c9-4e97-8fa0-dc244fd9dda7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:00.953104 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6898894f-21c9-4e97-8fa0-dc244fd9dda7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:00.953825 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6898894f-21c9-4e97-8fa0-dc244fd9dda7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:00.954261 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6898894f-21c9-4e97-8fa0-dc244fd9dda7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:00.954688 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6898894f-21c9-4e97-8fa0-dc244fd9dda7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:00.997672 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a0818677-fd48-4e1b-9da8-08397c328903 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:01.008088 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-a0818677-fd48-4e1b-9da8-08397c328903 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1569 microversion: 2.1 time: 0.161428 Sep 23 15:26:01.009103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 363/708] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:00 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:01.225139 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6898894f-21c9-4e97-8fa0-dc244fd9dda7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:01.237562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-6898894f-21c9-4e97-8fa0-dc244fd9dda7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c" status: 200 len: 1362 microversion: 2.1 time: 0.296727 Sep 23 15:26:01.252461 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 346/709] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:00 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c => generated 1362 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:26:02.034118 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-2d09e0db-232f-40a8-8796-f826dea28b3a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:02.034665 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-2d09e0db-232f-40a8-8796-f826dea28b3a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:02.041079 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2d09e0db-232f-40a8-8796-f826dea28b3a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:02.041568 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2d09e0db-232f-40a8-8796-f826dea28b3a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:02.042001 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2d09e0db-232f-40a8-8796-f826dea28b3a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:02.042692 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2d09e0db-232f-40a8-8796-f826dea28b3a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:02.043142 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2d09e0db-232f-40a8-8796-f826dea28b3a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:02.043613 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2d09e0db-232f-40a8-8796-f826dea28b3a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:02.186025 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-2d09e0db-232f-40a8-8796-f826dea28b3a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:02.194255 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-2d09e0db-232f-40a8-8796-f826dea28b3a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1569 microversion: 2.1 time: 0.164886 Sep 23 15:26:02.194827 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 364/710] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:02 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:02.272021 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-17422e35-d2cc-40fe-bda4-e476e4225a4f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:02.273347 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-17422e35-d2cc-40fe-bda4-e476e4225a4f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:02.279939 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-17422e35-d2cc-40fe-bda4-e476e4225a4f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:02.281325 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-17422e35-d2cc-40fe-bda4-e476e4225a4f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:02.282070 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-17422e35-d2cc-40fe-bda4-e476e4225a4f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:02.282813 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-17422e35-d2cc-40fe-bda4-e476e4225a4f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:02.283342 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-17422e35-d2cc-40fe-bda4-e476e4225a4f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:02.283866 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-17422e35-d2cc-40fe-bda4-e476e4225a4f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:02.424698 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-17422e35-d2cc-40fe-bda4-e476e4225a4f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:02.432594 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-17422e35-d2cc-40fe-bda4-e476e4225a4f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c" status: 200 len: 1548 microversion: 2.1 time: 0.164619 Sep 23 15:26:02.433169 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 347/711] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:02 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:02.456515 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-6adefd12-4c32-4ace-a26d-f54fd5cde09a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:02.457087 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-6adefd12-4c32-4ace-a26d-f54fd5cde09a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:02.463012 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6adefd12-4c32-4ace-a26d-f54fd5cde09a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:02.463492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6adefd12-4c32-4ace-a26d-f54fd5cde09a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:02.463924 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6adefd12-4c32-4ace-a26d-f54fd5cde09a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:02.464637 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6adefd12-4c32-4ace-a26d-f54fd5cde09a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:02.465091 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6adefd12-4c32-4ace-a26d-f54fd5cde09a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:02.465514 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6adefd12-4c32-4ace-a26d-f54fd5cde09a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:02.546948 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-6adefd12-4c32-4ace-a26d-f54fd5cde09a tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094190 Sep 23 15:26:02.547539 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 365/712] 10.222.0.55 () {58 vars in 1275 bytes} [Fri Sep 23 15:26:02 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:26:03.225432 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-ffc72378-31d9-48f2-8fac-465164fbca79 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:03.227611 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-ffc72378-31d9-48f2-8fac-465164fbca79 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:03.239873 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ffc72378-31d9-48f2-8fac-465164fbca79 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:03.240933 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ffc72378-31d9-48f2-8fac-465164fbca79 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:03.241904 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ffc72378-31d9-48f2-8fac-465164fbca79 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:03.243518 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ffc72378-31d9-48f2-8fac-465164fbca79 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:03.245061 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ffc72378-31d9-48f2-8fac-465164fbca79 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:03.246334 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ffc72378-31d9-48f2-8fac-465164fbca79 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:03.315777 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-cab317f5-57fa-4812-af63-e98f7fff10c1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:03.316380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-cab317f5-57fa-4812-af63-e98f7fff10c1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:03.322208 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cab317f5-57fa-4812-af63-e98f7fff10c1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:03.322740 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cab317f5-57fa-4812-af63-e98f7fff10c1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:03.323168 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cab317f5-57fa-4812-af63-e98f7fff10c1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:03.323961 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cab317f5-57fa-4812-af63-e98f7fff10c1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:03.324442 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cab317f5-57fa-4812-af63-e98f7fff10c1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:03.324868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cab317f5-57fa-4812-af63-e98f7fff10c1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:03.351434 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-cab317f5-57fa-4812-af63-e98f7fff10c1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55/ips" status: 200 len: 152 microversion: 2.20 time: 0.040326 Sep 23 15:26:03.352142 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 366/713] 10.222.0.55 () {60 vars in 1289 bytes} [Fri Sep 23 15:26:03 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 15:26:03.480292 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-ffc72378-31d9-48f2-8fac-465164fbca79 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:03.490111 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-ffc72378-31d9-48f2-8fac-465164fbca79 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1569 microversion: 2.1 time: 0.275187 Sep 23 15:26:03.490807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 348/714] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:03 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1569 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:03.673466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b922560e-8b8a-4422-be3c-50a1850bcbe1 tempest-VolumesGetTestJSON-388295646 tempest-VolumesGetTestJSON-388295646-project] Action: 'create', calling method: .version_select at 0x7f82db84bf70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1703205572", "metadata": {"Type": "work"}}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:03.913521 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-813778d7-034d-4cec-9ac5-3d74580a915d req-507294e6-70cb-46ba-92f9-abd39a771ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f41b2c1-177e-47f5-b7d5-48166096714c", "tag": "55436e11-cb4f-4c3c-ab14-4385e7710520"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:03.924363 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-813778d7-034d-4cec-9ac5-3d74580a915d req-507294e6-70cb-46ba-92f9-abd39a771ed3 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:03.924972 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-813778d7-034d-4cec-9ac5-3d74580a915d req-507294e6-70cb-46ba-92f9-abd39a771ed3 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:03.926280 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-813778d7-034d-4cec-9ac5-3d74580a915d req-507294e6-70cb-46ba-92f9-abd39a771ed3 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:03.938154 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-813778d7-034d-4cec-9ac5-3d74580a915d req-507294e6-70cb-46ba-92f9-abd39a771ed3 service nova] Creating event network-changed:55436e11-cb4f-4c3c-ab14-4385e7710520 for instance 3f41b2c1-177e-47f5-b7d5-48166096714c on hv-cinder-85530 Sep 23 15:26:03.943827 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-813778d7-034d-4cec-9ac5-3d74580a915d req-507294e6-70cb-46ba-92f9-abd39a771ed3 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128397 Sep 23 15:26:03.944463 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 349/715] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:03.952020 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-d47c8b77-3038-4ce0-9452-3c4df9eca996 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2069957819"}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:03.953137 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-d47c8b77-3038-4ce0-9452-3c4df9eca996 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:03.960158 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d47c8b77-3038-4ce0-9452-3c4df9eca996 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:03.960649 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d47c8b77-3038-4ce0-9452-3c4df9eca996 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:03.961085 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d47c8b77-3038-4ce0-9452-3c4df9eca996 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:03.961801 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d47c8b77-3038-4ce0-9452-3c4df9eca996 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:03.962249 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d47c8b77-3038-4ce0-9452-3c4df9eca996 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:03.962812 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d47c8b77-3038-4ce0-9452-3c4df9eca996 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:04.141292 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.network.security_group_api [None req-d47c8b77-3038-4ce0-9452-3c4df9eca996 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Removing security group 2737feda-37fe-49e8-9669-324943584fe5 from port f8bb92b2-35e5-484a-adc2-f6309c059f45 Sep 23 15:26:04.800097 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-b922560e-8b8a-4422-be3c-50a1850bcbe1 tempest-VolumesGetTestJSON-388295646 tempest-VolumesGetTestJSON-388295646-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.256937 Sep 23 15:26:04.802435 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 367/716] 10.222.0.55 () {60 vars in 1156 bytes} [Fri Sep 23 15:26:03 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1260 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 23 15:26:04.817275 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-271b4e50-0705-423a-b05d-e2823d218204 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:04.818127 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-271b4e50-0705-423a-b05d-e2823d218204 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:04.821723 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-d47c8b77-3038-4ce0-9452-3c4df9eca996 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "POST /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df/action" status: 202 len: 0 microversion: 2.1 time: 0.875292 Sep 23 15:26:04.822604 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 350/717] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Sep 23 15:26:03 2022] POST /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df/action => generated 0 bytes in 878 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:26:04.827906 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-199c3606-560f-4dcb-bec3-79b35f3e62a7 tempest-VolumesGetTestJSON-388295646 tempest-VolumesGetTestJSON-388295646-project] Calling method '.version_select at 0x7f82dba50820>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:04.828153 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-271b4e50-0705-423a-b05d-e2823d218204 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:04.828911 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-271b4e50-0705-423a-b05d-e2823d218204 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:04.829541 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-271b4e50-0705-423a-b05d-e2823d218204 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:04.830410 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-271b4e50-0705-423a-b05d-e2823d218204 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:04.831053 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-271b4e50-0705-423a-b05d-e2823d218204 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:04.831648 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-271b4e50-0705-423a-b05d-e2823d218204 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:04.957677 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-199c3606-560f-4dcb-bec3-79b35f3e62a7 tempest-VolumesGetTestJSON-388295646 tempest-VolumesGetTestJSON-388295646-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c5412daf-5835-43c5-a624-f5460ba53d51" status: 200 len: 353 microversion: 2.1 time: 0.133789 Sep 23 15:26:04.958562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 351/718] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Sep 23 15:26:04 2022] GET /compute/v2.1/os-volumes/c5412daf-5835-43c5-a624-f5460ba53d51 => generated 353 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:05.295158 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-271b4e50-0705-423a-b05d-e2823d218204 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:05.307846 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-271b4e50-0705-423a-b05d-e2823d218204 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1569 microversion: 2.1 time: 0.503153 Sep 23 15:26:05.322837 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 368/719] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:04 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1569 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:05.969972 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-4f00ecee-e323-407f-b4bd-f79e88393804 req-ebe175c2-b79d-453f-b21f-1948bfcfbfb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14c2bdac-30a5-4a8a-ad91-191c529f77df", "tag": "f8bb92b2-35e5-484a-adc2-f6309c059f45"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:05.976324 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-641699ed-7df5-4e22-9838-36ac3bcf8648 tempest-VolumesGetTestJSON-388295646 tempest-VolumesGetTestJSON-388295646-project] Calling method '.version_select at 0x7f82db892ee0>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:05.981615 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-4f00ecee-e323-407f-b4bd-f79e88393804 req-ebe175c2-b79d-453f-b21f-1948bfcfbfb3 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:05.982115 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-4f00ecee-e323-407f-b4bd-f79e88393804 req-ebe175c2-b79d-453f-b21f-1948bfcfbfb3 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:05.982703 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-4f00ecee-e323-407f-b4bd-f79e88393804 req-ebe175c2-b79d-453f-b21f-1948bfcfbfb3 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:05.994795 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-4f00ecee-e323-407f-b4bd-f79e88393804 req-ebe175c2-b79d-453f-b21f-1948bfcfbfb3 service nova] Creating event network-changed:f8bb92b2-35e5-484a-adc2-f6309c059f45 for instance 14c2bdac-30a5-4a8a-ad91-191c529f77df on hv-cinder-85530 Sep 23 15:26:06.000717 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-4f00ecee-e323-407f-b4bd-f79e88393804 req-ebe175c2-b79d-453f-b21f-1948bfcfbfb3 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035021 Sep 23 15:26:06.001617 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 352/720] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:06.043149 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-641699ed-7df5-4e22-9838-36ac3bcf8648 tempest-VolumesGetTestJSON-388295646 tempest-VolumesGetTestJSON-388295646-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c5412daf-5835-43c5-a624-f5460ba53d51" status: 200 len: 354 microversion: 2.1 time: 0.073949 Sep 23 15:26:06.043824 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 369/721] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Sep 23 15:26:05 2022] GET /compute/v2.1/os-volumes/c5412daf-5835-43c5-a624-f5460ba53d51 => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:06.058563 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-e537573e-b488-4b08-bad1-2a08caf296d5 tempest-VolumesGetTestJSON-388295646 tempest-VolumesGetTestJSON-388295646-project] Calling method '.version_select at 0x7f82dba57160>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:06.111181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-e537573e-b488-4b08-bad1-2a08caf296d5 tempest-VolumesGetTestJSON-388295646 tempest-VolumesGetTestJSON-388295646-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c5412daf-5835-43c5-a624-f5460ba53d51" status: 200 len: 354 microversion: 2.1 time: 0.057008 Sep 23 15:26:06.111963 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 353/722] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Sep 23 15:26:06 2022] GET /compute/v2.1/os-volumes/c5412daf-5835-43c5-a624-f5460ba53d51 => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:26:06.136750 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-24ec2843-d257-4c37-820c-62d7b5184e5e tempest-VolumesGetTestJSON-388295646 tempest-VolumesGetTestJSON-388295646-project] Calling method '.version_select at 0x7f82db84bee0>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:06.335397 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-d740fd93-50f8-463b-919c-18f7e5f03498 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:06.336276 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-d740fd93-50f8-463b-919c-18f7e5f03498 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:06.343773 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d740fd93-50f8-463b-919c-18f7e5f03498 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:06.346134 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d740fd93-50f8-463b-919c-18f7e5f03498 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:06.346134 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d740fd93-50f8-463b-919c-18f7e5f03498 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:06.346134 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d740fd93-50f8-463b-919c-18f7e5f03498 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:06.346531 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d740fd93-50f8-463b-919c-18f7e5f03498 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:06.346962 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d740fd93-50f8-463b-919c-18f7e5f03498 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:06.546682 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-24ec2843-d257-4c37-820c-62d7b5184e5e tempest-VolumesGetTestJSON-388295646 tempest-VolumesGetTestJSON-388295646-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/c5412daf-5835-43c5-a624-f5460ba53d51" status: 202 len: 0 microversion: 2.1 time: 0.413964 Sep 23 15:26:06.547547 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 370/723] 10.222.0.55 () {58 vars in 1248 bytes} [Fri Sep 23 15:26:06 2022] DELETE /compute/v2.1/os-volumes/c5412daf-5835-43c5-a624-f5460ba53d51 => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:26:06.554657 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-7d39941f-ebcb-4b60-b416-b8243e4aac2b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:06.555227 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-7d39941f-ebcb-4b60-b416-b8243e4aac2b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:06.557335 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:06.564168 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7d39941f-ebcb-4b60-b416-b8243e4aac2b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:06.564656 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7d39941f-ebcb-4b60-b416-b8243e4aac2b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:06.565091 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7d39941f-ebcb-4b60-b416-b8243e4aac2b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:06.566160 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7d39941f-ebcb-4b60-b416-b8243e4aac2b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:06.566616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7d39941f-ebcb-4b60-b416-b8243e4aac2b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:06.567039 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7d39941f-ebcb-4b60-b416-b8243e4aac2b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:06.590917 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.objects.instance [None req-7d39941f-ebcb-4b60-b416-b8243e4aac2b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lazy-loading 'flavor' on Instance uuid 46eb43e1-8a8e-4c5e-a071-ef900f024b55 {{(pid=121450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:26:06.631598 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-d740fd93-50f8-463b-919c-18f7e5f03498 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:06.640273 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-d740fd93-50f8-463b-919c-18f7e5f03498 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1569 microversion: 2.1 time: 0.308210 Sep 23 15:26:06.641152 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 354/724] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:06 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1569 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:06.645463 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-da7e7e19-bc7e-4b11-9372-36cfff289e5d tempest-VolumesGetTestJSON-388295646 tempest-VolumesGetTestJSON-388295646-project] Calling method '.version_select at 0x7f82dba50820>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:06.695126 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-da7e7e19-bc7e-4b11-9372-36cfff289e5d tempest-VolumesGetTestJSON-388295646 tempest-VolumesGetTestJSON-388295646-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c5412daf-5835-43c5-a624-f5460ba53d51" status: 200 len: 353 microversion: 2.1 time: 0.052967 Sep 23 15:26:06.695704 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 355/725] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Sep 23 15:26:06 2022] GET /compute/v2.1/os-volumes/c5412daf-5835-43c5-a624-f5460ba53d51 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:07.139549 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-c8cb10e9-4d5a-4911-90d4-eb95aa8d6d06 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:07.140299 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-c8cb10e9-4d5a-4911-90d4-eb95aa8d6d06 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:07.146584 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c8cb10e9-4d5a-4911-90d4-eb95aa8d6d06 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:07.147337 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c8cb10e9-4d5a-4911-90d4-eb95aa8d6d06 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:07.147850 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c8cb10e9-4d5a-4911-90d4-eb95aa8d6d06 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:07.148692 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c8cb10e9-4d5a-4911-90d4-eb95aa8d6d06 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:07.149224 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c8cb10e9-4d5a-4911-90d4-eb95aa8d6d06 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:07.149860 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c8cb10e9-4d5a-4911-90d4-eb95aa8d6d06 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:07.281645 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.objects.instance [None req-c8cb10e9-4d5a-4911-90d4-eb95aa8d6d06 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lazy-loading 'services' on Instance uuid 14c2bdac-30a5-4a8a-ad91-191c529f77df {{(pid=121448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:26:07.361251 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-7d39941f-ebcb-4b60-b416-b8243e4aac2b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "POST /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55/action" status: 202 len: 0 microversion: 2.20 time: 0.811819 Sep 23 15:26:07.362664 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 371/726] 10.222.0.55 () {62 vars in 1319 bytes} [Fri Sep 23 15:26:06 2022] POST /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55/action => generated 0 bytes in 814 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:26:07.371861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-1e265a25-e6f1-4511-a80c-584810307c5b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:07.372592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-1e265a25-e6f1-4511-a80c-584810307c5b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:07.382185 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1e265a25-e6f1-4511-a80c-584810307c5b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:07.382679 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1e265a25-e6f1-4511-a80c-584810307c5b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:07.383105 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1e265a25-e6f1-4511-a80c-584810307c5b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:07.383798 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1e265a25-e6f1-4511-a80c-584810307c5b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:07.384272 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1e265a25-e6f1-4511-a80c-584810307c5b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:07.384697 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1e265a25-e6f1-4511-a80c-584810307c5b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:07.550764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-1e265a25-e6f1-4511-a80c-584810307c5b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:07.560979 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-1e265a25-e6f1-4511-a80c-584810307c5b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:07.564124 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-1e265a25-e6f1-4511-a80c-584810307c5b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:07.565644 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-1e265a25-e6f1-4511-a80c-584810307c5b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1723 microversion: 2.20 time: 0.198662 Sep 23 15:26:07.580649 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 372/727] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:07 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:26:07.661340 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-c8cb10e9-4d5a-4911-90d4-eb95aa8d6d06 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "DELETE /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df/os-volume_attachments/6c1b54a7-1626-4cff-ae22-12dac645ade7" status: 202 len: 0 microversion: 2.1 time: 0.525860 Sep 23 15:26:07.662316 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 356/728] 10.222.0.55 () {58 vars in 1416 bytes} [Fri Sep 23 15:26:07 2022] DELETE /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df/os-volume_attachments/6c1b54a7-1626-4cff-ae22-12dac645ade7 => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 15:26:07.669192 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-6e54cf8d-77b7-4d51-9064-ff9526e8b487 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:07.670306 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-6e54cf8d-77b7-4d51-9064-ff9526e8b487 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:07.677457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e54cf8d-77b7-4d51-9064-ff9526e8b487 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:07.678419 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e54cf8d-77b7-4d51-9064-ff9526e8b487 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:07.679020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e54cf8d-77b7-4d51-9064-ff9526e8b487 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:07.679891 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e54cf8d-77b7-4d51-9064-ff9526e8b487 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:07.680852 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e54cf8d-77b7-4d51-9064-ff9526e8b487 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:07.681323 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e54cf8d-77b7-4d51-9064-ff9526e8b487 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:07.684219 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-17deb7c1-be51-4c60-a8f9-5ee8008a977a tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:07.689022 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-17deb7c1-be51-4c60-a8f9-5ee8008a977a tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:07.700611 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-17deb7c1-be51-4c60-a8f9-5ee8008a977a tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:07.701201 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-17deb7c1-be51-4c60-a8f9-5ee8008a977a tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:07.702500 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-17deb7c1-be51-4c60-a8f9-5ee8008a977a tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:07.703449 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-17deb7c1-be51-4c60-a8f9-5ee8008a977a tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:07.706480 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-17deb7c1-be51-4c60-a8f9-5ee8008a977a tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:07.706993 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-17deb7c1-be51-4c60-a8f9-5ee8008a977a tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:07.740986 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-17deb7c1-be51-4c60-a8f9-5ee8008a977a tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067413 Sep 23 15:26:07.742535 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 357/729] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Sep 23 15:26:07 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:07.747334 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-bd59cedf-1a49-4719-a04f-319fb98f4635 tempest-VolumesGetTestJSON-388295646 tempest-VolumesGetTestJSON-388295646-project] Calling method '.version_select at 0x7f82dbb80040>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:07.787908 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.wsgi [None req-bd59cedf-1a49-4719-a04f-319fb98f4635 tempest-VolumesGetTestJSON-388295646 tempest-VolumesGetTestJSON-388295646-project] HTTP exception thrown: Volume c5412daf-5835-43c5-a624-f5460ba53d51 could not be found. Sep 23 15:26:07.790100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-bd59cedf-1a49-4719-a04f-319fb98f4635 tempest-VolumesGetTestJSON-388295646 tempest-VolumesGetTestJSON-388295646-project] Request method failure captured: Sep 23 15:26:07.790100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: request: GET /compute/v2.1/os-volumes/c5412daf-5835-43c5-a624-f5460ba53d51 HTTP/1.1 Sep 23 15:26:07.790100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept: application/json Sep 23 15:26:07.790100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept-Encoding: identity Sep 23 15:26:07.790100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Connection: close Sep 23 15:26:07.790100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Length: 0 Sep 23 15:26:07.790100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Type: application/json Sep 23 15:26:07.790100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Host: 10.222.0.55 Sep 23 15:26:07.790100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Openstack-System-Scope: None Sep 23 15:26:07.790100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: User-Agent: python-urllib3/1.26.12 Sep 23 15:26:07.790100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Auth-Token: gAAAAABjLdALppzNz9FrCpWaDyJ6SJcQ5dDqgIjjWDe_yJbTFeJ7zG2UXhCwAZ9aWwlp8pLt_vlTRciwSxaCUaRWQIgntcqjx95nnhW5sMWImbs93_juS40jXhjkQow5_fGRMR7M7zSU6vUOqXuphUEajq4JR69NI0FYS5l8wsyyuxNdFUpH3jA Sep 23 15:26:07.790100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Id: None Sep 23 15:26:07.790100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Name: None Sep 23 15:26:07.790100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Identity-Status: Confirmed Sep 23 15:26:07.790100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Is-Admin-Project: True Sep 23 15:26:07.790100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Id: default Sep 23 15:26:07.790100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Name: Default Sep 23 15:26:07.790100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Id: ccf1290dbdf04673949ac453cf3c8939 Sep 23 15:26:07.790100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Name: tempest-VolumesGetTestJSON-388295646 Sep 23 15:26:07.790100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Role: reader,member Sep 23 15:26:07.790100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Roles: reader,member Sep 23 15:26:07.791744 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ccf1290dbdf04673949ac453cf3c8939"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ccf1290dbdf04673949ac453cf3c8939"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ccf1290dbdf04673949ac453cf3c8939", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ccf1290dbdf04673949ac453cf3c8939"}]}] Sep 23 15:26:07.791744 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant: tempest-VolumesGetTestJSON-388295646 Sep 23 15:26:07.791744 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Id: ccf1290dbdf04673949ac453cf3c8939 Sep 23 15:26:07.791744 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Name: tempest-VolumesGetTestJSON-388295646 Sep 23 15:26:07.791744 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User: tempest-VolumesGetTestJSON-388295646-project Sep 23 15:26:07.791744 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Id: default Sep 23 15:26:07.791744 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Name: Default Sep 23 15:26:07.791744 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Id: 83cddbd5031f45499dbf8f12a44e63ed Sep 23 15:26:07.791744 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Name: tempest-VolumesGetTestJSON-388295646-project Sep 23 15:26:07.791744 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: method: Sep 23 15:26:07.791744 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: exception: Volume c5412daf-5835-43c5-a624-f5460ba53d51 could not be found. Sep 23 15:26:07.791744 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: action_args: {'id': 'c5412daf-5835-43c5-a624-f5460ba53d51'} Sep 23 15:26:07.791744 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:26:07.792783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:07.792783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:26:07.792783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:26:07.792783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 15:26:07.792783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 15:26:07.792783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 15:26:07.792783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 15:26:07.792783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 15:26:07.792783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 15:26:07.792783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 15:26:07.792783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 15:26:07.792783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:26:07.792783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:26:07.792783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:26:07.792783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:26:07.792783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c5412daf-5835-43c5-a624-f5460ba53d51 could not be found. (HTTP 404) (Request-ID: req-c617777b-96af-4318-b431-b2179f4f9cb4) Sep 23 15:26:07.792783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:26:07.792783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:26:07.792783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:26:07.794026 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:07.794026 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 23 15:26:07.794026 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 23 15:26:07.794026 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 15:26:07.794026 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 15:26:07.794026 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 15:26:07.794026 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 15:26:07.794026 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 15:26:07.794026 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 15:26:07.794026 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:26:07.794026 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:26:07.794026 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 15:26:07.794026 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 15:26:07.794026 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 15:26:07.794026 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 15:26:07.794026 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 15:26:07.794026 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 15:26:07.794026 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 15:26:07.794026 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 15:26:07.795266 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:26:07.795266 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:26:07.795266 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:26:07.795266 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:26:07.795266 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c5412daf-5835-43c5-a624-f5460ba53d51 could not be found. Sep 23 15:26:07.795266 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:26:07.795266 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:26:07.795266 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:26:07.795266 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:07.795266 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:26:07.795266 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:26:07.795266 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:26:07.795266 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:26:07.795266 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 15:26:07.795266 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 15:26:07.795266 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:26:07.795266 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:26:07.795266 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 23 15:26:07.795266 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:26:07.797730 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c5412daf-5835-43c5-a624-f5460ba53d51 could not be found. Sep 23 15:26:07.797730 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:26:07.797730 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:26:07.797730 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:26:07.797730 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:07.797730 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:26:07.797730 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:26:07.797730 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:26:07.797730 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:26:07.797730 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c5412daf-5835-43c5-a624-f5460ba53d51 could not be found. Sep 23 15:26:07.797730 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:26:07.797730 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-bd59cedf-1a49-4719-a04f-319fb98f4635 tempest-VolumesGetTestJSON-388295646 tempest-VolumesGetTestJSON-388295646-project] Returning 404 to user: Volume c5412daf-5835-43c5-a624-f5460ba53d51 could not be found. {{(pid=121448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:26:07.797730 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-bd59cedf-1a49-4719-a04f-319fb98f4635 tempest-VolumesGetTestJSON-388295646 tempest-VolumesGetTestJSON-388295646-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c5412daf-5835-43c5-a624-f5460ba53d51" status: 404 len: 109 microversion: 2.1 time: 0.048240 Sep 23 15:26:07.797730 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 358/730] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Sep 23 15:26:07 2022] GET /compute/v2.1/os-volumes/c5412daf-5835-43c5-a624-f5460ba53d51 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:26:07.857834 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-6e54cf8d-77b7-4d51-9064-ff9526e8b487 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:07.874579 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-6e54cf8d-77b7-4d51-9064-ff9526e8b487 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1569 microversion: 2.1 time: 0.208780 Sep 23 15:26:07.875432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 373/731] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:07 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1569 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:26:08.025543 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-87853b09-7623-4896-9fae-3b15dfd13033 req-0551d05a-e17a-4cbf-a01a-ef2c62043ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14c2bdac-30a5-4a8a-ad91-191c529f77df", "tag": "f8bb92b2-35e5-484a-adc2-f6309c059f45"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:08.037548 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-87853b09-7623-4896-9fae-3b15dfd13033 req-0551d05a-e17a-4cbf-a01a-ef2c62043ef7 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:08.037969 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-87853b09-7623-4896-9fae-3b15dfd13033 req-0551d05a-e17a-4cbf-a01a-ef2c62043ef7 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:08.038522 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-87853b09-7623-4896-9fae-3b15dfd13033 req-0551d05a-e17a-4cbf-a01a-ef2c62043ef7 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:08.050252 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-87853b09-7623-4896-9fae-3b15dfd13033 req-0551d05a-e17a-4cbf-a01a-ef2c62043ef7 service nova] Creating event network-changed:f8bb92b2-35e5-484a-adc2-f6309c059f45 for instance 14c2bdac-30a5-4a8a-ad91-191c529f77df on hv-cinder-85530 Sep 23 15:26:08.055293 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-87853b09-7623-4896-9fae-3b15dfd13033 req-0551d05a-e17a-4cbf-a01a-ef2c62043ef7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033502 Sep 23 15:26:08.055885 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 359/732] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:08.594022 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-d7a53ab3-6e5c-4f40-a93e-a20923da2a9b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:08.595786 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-d7a53ab3-6e5c-4f40-a93e-a20923da2a9b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:08.609301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d7a53ab3-6e5c-4f40-a93e-a20923da2a9b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:08.610534 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d7a53ab3-6e5c-4f40-a93e-a20923da2a9b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:08.611654 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d7a53ab3-6e5c-4f40-a93e-a20923da2a9b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:08.613733 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d7a53ab3-6e5c-4f40-a93e-a20923da2a9b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:08.614832 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d7a53ab3-6e5c-4f40-a93e-a20923da2a9b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:08.615587 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d7a53ab3-6e5c-4f40-a93e-a20923da2a9b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:08.757279 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-98460cba-ae72-4b16-b168-48415adf4b26 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:08.759502 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-98460cba-ae72-4b16-b168-48415adf4b26 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:08.765942 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-98460cba-ae72-4b16-b168-48415adf4b26 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:08.766427 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-98460cba-ae72-4b16-b168-48415adf4b26 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:08.766872 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-98460cba-ae72-4b16-b168-48415adf4b26 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:08.767571 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-98460cba-ae72-4b16-b168-48415adf4b26 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:08.768056 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-98460cba-ae72-4b16-b168-48415adf4b26 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:08.768486 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-98460cba-ae72-4b16-b168-48415adf4b26 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:08.798390 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-98460cba-ae72-4b16-b168-48415adf4b26 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046007 Sep 23 15:26:08.798973 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 360/733] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Sep 23 15:26:08 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:26:08.903679 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-beadf301-351d-4b73-9722-1e15d063dfc4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:08.903679 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-beadf301-351d-4b73-9722-1e15d063dfc4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:08.913030 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-beadf301-351d-4b73-9722-1e15d063dfc4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:08.913579 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-beadf301-351d-4b73-9722-1e15d063dfc4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:08.914001 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-beadf301-351d-4b73-9722-1e15d063dfc4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:08.914887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-beadf301-351d-4b73-9722-1e15d063dfc4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:08.915380 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-beadf301-351d-4b73-9722-1e15d063dfc4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:08.915829 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-beadf301-351d-4b73-9722-1e15d063dfc4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:09.118043 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-beadf301-351d-4b73-9722-1e15d063dfc4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:09.127060 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-beadf301-351d-4b73-9722-1e15d063dfc4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1570 microversion: 2.1 time: 0.232284 Sep 23 15:26:09.127729 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 361/734] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:08 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1570 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:09.150565 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-900cdf66-4dbb-4290-94e6-3fafe2de88ff tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:09.151165 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-900cdf66-4dbb-4290-94e6-3fafe2de88ff tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:09.161085 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-900cdf66-4dbb-4290-94e6-3fafe2de88ff tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:09.161627 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-900cdf66-4dbb-4290-94e6-3fafe2de88ff tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:09.162370 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-900cdf66-4dbb-4290-94e6-3fafe2de88ff tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:09.163255 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-900cdf66-4dbb-4290-94e6-3fafe2de88ff tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:09.163818 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-900cdf66-4dbb-4290-94e6-3fafe2de88ff tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:09.164394 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-900cdf66-4dbb-4290-94e6-3fafe2de88ff tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:09.168669 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-d7a53ab3-6e5c-4f40-a93e-a20923da2a9b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:09.178620 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-d7a53ab3-6e5c-4f40-a93e-a20923da2a9b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:09.180084 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-d7a53ab3-6e5c-4f40-a93e-a20923da2a9b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:09.181266 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-d7a53ab3-6e5c-4f40-a93e-a20923da2a9b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1723 microversion: 2.20 time: 0.592151 Sep 23 15:26:09.181821 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 374/735] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:08 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1723 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:26:09.215483 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-900cdf66-4dbb-4290-94e6-3fafe2de88ff tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121448) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 23 15:26:09.752417 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-900cdf66-4dbb-4290-94e6-3fafe2de88ff tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "POST /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb/action" status: 202 len: 0 microversion: 2.1 time: 0.605719 Sep 23 15:26:09.753328 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 362/736] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Sep 23 15:26:09 2022] POST /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb/action => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 15:26:09.767207 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-60b1bfb3-9296-466f-a409-d07c89c185aa tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:09.768971 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-60b1bfb3-9296-466f-a409-d07c89c185aa tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:09.778306 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-60b1bfb3-9296-466f-a409-d07c89c185aa tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:09.778815 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-60b1bfb3-9296-466f-a409-d07c89c185aa tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:09.779252 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-60b1bfb3-9296-466f-a409-d07c89c185aa tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:09.780247 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-60b1bfb3-9296-466f-a409-d07c89c185aa tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:09.787125 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-60b1bfb3-9296-466f-a409-d07c89c185aa tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:09.787125 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-60b1bfb3-9296-466f-a409-d07c89c185aa tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:09.812556 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-63abc62a-0b6d-4437-b657-5febda7f3742 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:09.814899 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-63abc62a-0b6d-4437-b657-5febda7f3742 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:09.821404 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-63abc62a-0b6d-4437-b657-5febda7f3742 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:09.821820 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-63abc62a-0b6d-4437-b657-5febda7f3742 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:09.822273 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-63abc62a-0b6d-4437-b657-5febda7f3742 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:09.823018 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-63abc62a-0b6d-4437-b657-5febda7f3742 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:09.823436 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-63abc62a-0b6d-4437-b657-5febda7f3742 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:09.823888 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-63abc62a-0b6d-4437-b657-5febda7f3742 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:09.856265 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-63abc62a-0b6d-4437-b657-5febda7f3742 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049308 Sep 23 15:26:09.856825 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 363/737] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Sep 23 15:26:09 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 15:26:09.867815 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-152722fb-1136-4148-8d00-54572e54a220 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:09.868345 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-152722fb-1136-4148-8d00-54572e54a220 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:09.875027 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-152722fb-1136-4148-8d00-54572e54a220 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:09.875564 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-152722fb-1136-4148-8d00-54572e54a220 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:09.876024 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-152722fb-1136-4148-8d00-54572e54a220 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:09.876721 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-152722fb-1136-4148-8d00-54572e54a220 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:09.877182 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-152722fb-1136-4148-8d00-54572e54a220 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:09.877608 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-152722fb-1136-4148-8d00-54572e54a220 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:09.945657 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-60b1bfb3-9296-466f-a409-d07c89c185aa tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:09.953691 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-60b1bfb3-9296-466f-a409-d07c89c185aa tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1518 microversion: 2.1 time: 0.191975 Sep 23 15:26:09.955417 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 375/738] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:09 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1518 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:09.981563 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.wsgi [None req-152722fb-1136-4148-8d00-54572e54a220 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] HTTP exception thrown: Instance 14c2bdac-30a5-4a8a-ad91-191c529f77df is not attached to volume 6c1b54a7-1626-4cff-ae22-12dac645ade7 Sep 23 15:26:09.984809 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-152722fb-1136-4148-8d00-54572e54a220 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Request method failure captured: Sep 23 15:26:09.984809 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: request: DELETE /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df/os-volume_attachments/6c1b54a7-1626-4cff-ae22-12dac645ade7 HTTP/1.1 Sep 23 15:26:09.984809 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept: application/json Sep 23 15:26:09.984809 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept-Encoding: identity Sep 23 15:26:09.984809 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Connection: close Sep 23 15:26:09.984809 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Length: 0 Sep 23 15:26:09.984809 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Type: application/json Sep 23 15:26:09.984809 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Host: 10.222.0.55 Sep 23 15:26:09.984809 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Openstack-System-Scope: None Sep 23 15:26:09.984809 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: User-Agent: python-urllib3/1.26.12 Sep 23 15:26:09.984809 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Auth-Token: gAAAAABjLc9x4yFRhsibLSorJdZO6mepLeBRSv147O0ymmBFT22aWYs72B4C3R6UTZ9fYvGBx0TBTtssMpGFgSmLfaMkQYgUE7N_cKZ7GjhStBR3CUVSOv5ciBCNGN9LZgYCPpbl4mdD7MBA9uBlUbKJFSo7equyuRtjVL8xV7MNsaolQ7a79Fo Sep 23 15:26:09.984809 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Id: None Sep 23 15:26:09.984809 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Name: None Sep 23 15:26:09.984809 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Identity-Status: Confirmed Sep 23 15:26:09.984809 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Is-Admin-Project: True Sep 23 15:26:09.984809 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Id: default Sep 23 15:26:09.984809 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Name: Default Sep 23 15:26:09.984809 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Id: efbab8ef4fbd4c61811d0fc046290937 Sep 23 15:26:09.984809 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Name: tempest-TestMinimumBasicScenario-140355407 Sep 23 15:26:09.984809 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Role: reader,member Sep 23 15:26:09.984809 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Roles: reader,member Sep 23 15:26:09.986150 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/efbab8ef4fbd4c61811d0fc046290937"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/efbab8ef4fbd4c61811d0fc046290937"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_efbab8ef4fbd4c61811d0fc046290937", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/efbab8ef4fbd4c61811d0fc046290937"}]}] Sep 23 15:26:09.986150 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant: tempest-TestMinimumBasicScenario-140355407 Sep 23 15:26:09.986150 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Id: efbab8ef4fbd4c61811d0fc046290937 Sep 23 15:26:09.986150 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Name: tempest-TestMinimumBasicScenario-140355407 Sep 23 15:26:09.986150 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User: tempest-TestMinimumBasicScenario-140355407-project Sep 23 15:26:09.986150 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Id: default Sep 23 15:26:09.986150 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Name: Default Sep 23 15:26:09.986150 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Id: deda513f4c6448368cfa79203cf0d8d8 Sep 23 15:26:09.986150 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Name: tempest-TestMinimumBasicScenario-140355407-project Sep 23 15:26:09.986150 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: method: > Sep 23 15:26:09.986150 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: exception: Instance 14c2bdac-30a5-4a8a-ad91-191c529f77df is not attached to volume 6c1b54a7-1626-4cff-ae22-12dac645ade7 Sep 23 15:26:09.986859 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: action_args: {'server_id': '14c2bdac-30a5-4a8a-ad91-191c529f77df', 'id': '6c1b54a7-1626-4cff-ae22-12dac645ade7'} Sep 23 15:26:09.986859 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:26:09.986859 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:09.986859 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 23 15:26:09.986859 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 23 15:26:09.986859 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 15:26:09.986859 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 15:26:09.986859 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 23 15:26:09.986859 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 23 15:26:09.986859 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6c1b54a7-1626-4cff-ae22-12dac645ade7. Sep 23 15:26:09.986859 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:26:09.986859 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:26:09.986859 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:26:09.986859 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:09.986859 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:26:09.986859 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:26:09.986859 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:26:09.986859 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:26:09.986859 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:26:09.988074 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:26:09.988074 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 23 15:26:09.988074 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 15:26:09.988074 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14c2bdac-30a5-4a8a-ad91-191c529f77df is not attached to volume 6c1b54a7-1626-4cff-ae22-12dac645ade7 Sep 23 15:26:09.988074 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:26:09.988074 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:26:09.988074 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:26:09.988074 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:09.988074 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:26:09.988074 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:26:09.988074 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:26:09.988074 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:26:09.988074 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14c2bdac-30a5-4a8a-ad91-191c529f77df is not attached to volume 6c1b54a7-1626-4cff-ae22-12dac645ade7 Sep 23 15:26:09.988074 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:26:09.990138 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-152722fb-1136-4148-8d00-54572e54a220 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Returning 404 to user: Instance 14c2bdac-30a5-4a8a-ad91-191c529f77df is not attached to volume 6c1b54a7-1626-4cff-ae22-12dac645ade7 {{(pid=121448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:26:09.991199 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-152722fb-1136-4148-8d00-54572e54a220 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "DELETE /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df/os-volume_attachments/6c1b54a7-1626-4cff-ae22-12dac645ade7" status: 404 len: 154 microversion: 2.1 time: 0.127669 Sep 23 15:26:09.991959 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 364/739] 10.222.0.55 () {58 vars in 1416 bytes} [Fri Sep 23 15:26:09 2022] DELETE /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df/os-volume_attachments/6c1b54a7-1626-4cff-ae22-12dac645ade7 => generated 154 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 15:26:10.206698 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-98aeec72-b448-4f50-b80c-7907cc8c957a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:10.207308 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-98aeec72-b448-4f50-b80c-7907cc8c957a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:10.213541 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-98aeec72-b448-4f50-b80c-7907cc8c957a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:10.214621 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-98aeec72-b448-4f50-b80c-7907cc8c957a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:10.215067 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-98aeec72-b448-4f50-b80c-7907cc8c957a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:10.215779 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-98aeec72-b448-4f50-b80c-7907cc8c957a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:10.216341 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-98aeec72-b448-4f50-b80c-7907cc8c957a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:10.216766 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-98aeec72-b448-4f50-b80c-7907cc8c957a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:10.366225 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-98aeec72-b448-4f50-b80c-7907cc8c957a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:10.376577 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-98aeec72-b448-4f50-b80c-7907cc8c957a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:10.378027 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-98aeec72-b448-4f50-b80c-7907cc8c957a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:10.379230 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-98aeec72-b448-4f50-b80c-7907cc8c957a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1723 microversion: 2.20 time: 0.176604 Sep 23 15:26:10.379794 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 376/740] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:10 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:10.977059 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-e82c5cc2-a88e-4bbf-a154-bb0221229f15 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:10.977666 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-e82c5cc2-a88e-4bbf-a154-bb0221229f15 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:10.985036 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e82c5cc2-a88e-4bbf-a154-bb0221229f15 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:10.985522 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e82c5cc2-a88e-4bbf-a154-bb0221229f15 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:10.985960 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e82c5cc2-a88e-4bbf-a154-bb0221229f15 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:10.986656 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e82c5cc2-a88e-4bbf-a154-bb0221229f15 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:10.987115 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e82c5cc2-a88e-4bbf-a154-bb0221229f15 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:10.987554 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e82c5cc2-a88e-4bbf-a154-bb0221229f15 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:11.126371 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-e82c5cc2-a88e-4bbf-a154-bb0221229f15 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:11.134459 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-e82c5cc2-a88e-4bbf-a154-bb0221229f15 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1518 microversion: 2.1 time: 0.161343 Sep 23 15:26:11.135028 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 365/741] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:10 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:11.393432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b06c5c87-6783-4c14-aee8-7c7f69f113da tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:11.393432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-b06c5c87-6783-4c14-aee8-7c7f69f113da tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:11.399652 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b06c5c87-6783-4c14-aee8-7c7f69f113da tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:11.400223 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b06c5c87-6783-4c14-aee8-7c7f69f113da tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:11.400608 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b06c5c87-6783-4c14-aee8-7c7f69f113da tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:11.401305 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b06c5c87-6783-4c14-aee8-7c7f69f113da tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:11.401756 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b06c5c87-6783-4c14-aee8-7c7f69f113da tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:11.402181 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b06c5c87-6783-4c14-aee8-7c7f69f113da tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:11.407432 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-15968a1d-4112-4c63-b061-580ec4b2d25a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:11.408217 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-15968a1d-4112-4c63-b061-580ec4b2d25a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:11.414221 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-15968a1d-4112-4c63-b061-580ec4b2d25a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:11.414850 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-15968a1d-4112-4c63-b061-580ec4b2d25a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:11.415292 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-15968a1d-4112-4c63-b061-580ec4b2d25a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:11.416015 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-15968a1d-4112-4c63-b061-580ec4b2d25a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:11.416474 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-15968a1d-4112-4c63-b061-580ec4b2d25a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:11.417112 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-15968a1d-4112-4c63-b061-580ec4b2d25a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:11.432226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-b06c5c87-6783-4c14-aee8-7c7f69f113da tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Going to try to terminate instance {{(pid=121450) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:26:11.438511 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:11.573840 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-15968a1d-4112-4c63-b061-580ec4b2d25a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:11.584015 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-15968a1d-4112-4c63-b061-580ec4b2d25a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:11.585757 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-15968a1d-4112-4c63-b061-580ec4b2d25a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:11.586975 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-15968a1d-4112-4c63-b061-580ec4b2d25a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1723 microversion: 2.20 time: 0.184419 Sep 23 15:26:11.587526 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 366/742] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:11 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:11.843482 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-b06c5c87-6783-4c14-aee8-7c7f69f113da tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "DELETE /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 204 len: 0 microversion: 2.1 time: 0.454147 Sep 23 15:26:11.844271 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 377/743] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Sep 23 15:26:11 2022] DELETE /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:26:11.853118 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-08b56624-d775-46e4-9a14-4a20972ea83d tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:11.853764 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-08b56624-d775-46e4-9a14-4a20972ea83d tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:11.862009 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-08b56624-d775-46e4-9a14-4a20972ea83d tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:11.862476 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-08b56624-d775-46e4-9a14-4a20972ea83d tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:11.863112 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-08b56624-d775-46e4-9a14-4a20972ea83d tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:11.863769 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-08b56624-d775-46e4-9a14-4a20972ea83d tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:11.864293 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-08b56624-d775-46e4-9a14-4a20972ea83d tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:11.864775 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-08b56624-d775-46e4-9a14-4a20972ea83d tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:12.004557 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-08b56624-d775-46e4-9a14-4a20972ea83d tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:12.012362 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-08b56624-d775-46e4-9a14-4a20972ea83d tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1555 microversion: 2.1 time: 0.163624 Sep 23 15:26:12.012935 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 367/744] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:11 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:12.159725 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-6d67521e-83b7-46a8-8fdc-137907a0da84 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:12.160528 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-6d67521e-83b7-46a8-8fdc-137907a0da84 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:12.166414 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6d67521e-83b7-46a8-8fdc-137907a0da84 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:12.166892 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6d67521e-83b7-46a8-8fdc-137907a0da84 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:12.172474 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6d67521e-83b7-46a8-8fdc-137907a0da84 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:12.172474 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6d67521e-83b7-46a8-8fdc-137907a0da84 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:12.172474 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6d67521e-83b7-46a8-8fdc-137907a0da84 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:12.172474 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6d67521e-83b7-46a8-8fdc-137907a0da84 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:12.173527 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:12.305886 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-6d67521e-83b7-46a8-8fdc-137907a0da84 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:12.314651 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-6d67521e-83b7-46a8-8fdc-137907a0da84 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1520 microversion: 2.1 time: 0.159185 Sep 23 15:26:12.315225 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 378/745] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:12 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:12.527228 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-a3551986-19a1-4bdb-8503-3fd4f44f4039 req-368ce8cf-492f-4ad8-a9e7-01174d5576e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74b48a2a-0dde-4289-b8d6-788a66dafddb", "name": "network-vif-unplugged", "status": "completed", "tag": "0c8439ba-0b08-4cad-8937-aa360e2a93ed"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:12.537996 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-a3551986-19a1-4bdb-8503-3fd4f44f4039 req-368ce8cf-492f-4ad8-a9e7-01174d5576e2 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:12.538653 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-a3551986-19a1-4bdb-8503-3fd4f44f4039 req-368ce8cf-492f-4ad8-a9e7-01174d5576e2 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:12.539259 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-a3551986-19a1-4bdb-8503-3fd4f44f4039 req-368ce8cf-492f-4ad8-a9e7-01174d5576e2 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:12.553694 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.compute.server_external_events [req-a3551986-19a1-4bdb-8503-3fd4f44f4039 req-368ce8cf-492f-4ad8-a9e7-01174d5576e2 service nova] Unable to find a host for instance 74b48a2a-0dde-4289-b8d6-788a66dafddb. Dropping event network-vif-unplugged {{(pid=121448) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 23 15:26:12.554867 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-a3551986-19a1-4bdb-8503-3fd4f44f4039 req-368ce8cf-492f-4ad8-a9e7-01174d5576e2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033292 Sep 23 15:26:12.556146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 368/746] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 23 15:26:12.614160 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-eebbfd85-34af-4a5a-b018-9596cd7405f6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:12.616688 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-eebbfd85-34af-4a5a-b018-9596cd7405f6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:12.624713 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eebbfd85-34af-4a5a-b018-9596cd7405f6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:12.625211 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eebbfd85-34af-4a5a-b018-9596cd7405f6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:12.625649 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eebbfd85-34af-4a5a-b018-9596cd7405f6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:12.626526 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eebbfd85-34af-4a5a-b018-9596cd7405f6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:12.627152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eebbfd85-34af-4a5a-b018-9596cd7405f6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:12.627616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eebbfd85-34af-4a5a-b018-9596cd7405f6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:12.777823 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-eebbfd85-34af-4a5a-b018-9596cd7405f6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:12.786593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-eebbfd85-34af-4a5a-b018-9596cd7405f6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:12.788084 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-eebbfd85-34af-4a5a-b018-9596cd7405f6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:12.789270 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-eebbfd85-34af-4a5a-b018-9596cd7405f6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1723 microversion: 2.20 time: 0.179142 Sep 23 15:26:12.789831 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 379/747] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:12 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:13.036956 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-36343473-97d3-4df4-8c3b-e56a69d07205 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:13.037642 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-36343473-97d3-4df4-8c3b-e56a69d07205 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:13.044759 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-36343473-97d3-4df4-8c3b-e56a69d07205 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:13.045291 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-36343473-97d3-4df4-8c3b-e56a69d07205 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:13.046056 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-36343473-97d3-4df4-8c3b-e56a69d07205 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:13.046794 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-36343473-97d3-4df4-8c3b-e56a69d07205 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:13.047309 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-36343473-97d3-4df4-8c3b-e56a69d07205 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:13.047799 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-36343473-97d3-4df4-8c3b-e56a69d07205 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:13.187250 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-36343473-97d3-4df4-8c3b-e56a69d07205 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:13.195464 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-36343473-97d3-4df4-8c3b-e56a69d07205 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1555 microversion: 2.1 time: 0.162605 Sep 23 15:26:13.196345 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 369/748] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:13 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:13.337963 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-f4736529-9c36-44b5-9345-c468ace68953 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:13.338540 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-f4736529-9c36-44b5-9345-c468ace68953 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:13.345398 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f4736529-9c36-44b5-9345-c468ace68953 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:13.345870 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f4736529-9c36-44b5-9345-c468ace68953 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:13.346293 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f4736529-9c36-44b5-9345-c468ace68953 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:13.346963 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f4736529-9c36-44b5-9345-c468ace68953 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:13.347405 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f4736529-9c36-44b5-9345-c468ace68953 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:13.347817 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f4736529-9c36-44b5-9345-c468ace68953 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:13.480790 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-f4736529-9c36-44b5-9345-c468ace68953 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:13.488983 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-f4736529-9c36-44b5-9345-c468ace68953 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1520 microversion: 2.1 time: 0.155079 Sep 23 15:26:13.489554 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 380/749] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:13 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:13.816592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-98186bc0-5ba6-4efb-bff1-de22f19bfe80 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:13.821406 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-98186bc0-5ba6-4efb-bff1-de22f19bfe80 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:13.823394 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-98186bc0-5ba6-4efb-bff1-de22f19bfe80 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:13.823883 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-98186bc0-5ba6-4efb-bff1-de22f19bfe80 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:13.824360 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-98186bc0-5ba6-4efb-bff1-de22f19bfe80 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:13.825101 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-98186bc0-5ba6-4efb-bff1-de22f19bfe80 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:13.825778 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-98186bc0-5ba6-4efb-bff1-de22f19bfe80 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:13.826255 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-98186bc0-5ba6-4efb-bff1-de22f19bfe80 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:13.971222 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-98186bc0-5ba6-4efb-bff1-de22f19bfe80 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:13.980474 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-98186bc0-5ba6-4efb-bff1-de22f19bfe80 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:13.982045 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-98186bc0-5ba6-4efb-bff1-de22f19bfe80 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:13.984313 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-98186bc0-5ba6-4efb-bff1-de22f19bfe80 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1723 microversion: 2.20 time: 0.171968 Sep 23 15:26:13.984888 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 370/750] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:13 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:14.220971 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-22007c8e-03e8-4134-a82a-2274c467c7b8 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:14.221550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-22007c8e-03e8-4134-a82a-2274c467c7b8 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:14.228144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-22007c8e-03e8-4134-a82a-2274c467c7b8 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:14.228703 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-22007c8e-03e8-4134-a82a-2274c467c7b8 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:14.229159 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-22007c8e-03e8-4134-a82a-2274c467c7b8 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:14.229910 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-22007c8e-03e8-4134-a82a-2274c467c7b8 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:14.230368 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-22007c8e-03e8-4134-a82a-2274c467c7b8 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:14.230794 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-22007c8e-03e8-4134-a82a-2274c467c7b8 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:14.448069 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-22007c8e-03e8-4134-a82a-2274c467c7b8 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:14.457226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-22007c8e-03e8-4134-a82a-2274c467c7b8 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1555 microversion: 2.1 time: 0.241566 Sep 23 15:26:14.458091 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 381/751] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:14 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1555 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:14.461393 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-8a42a0ef-3b99-4937-85b0-afc0f6ecbb40 req-ec9b540a-14bd-4411-9b5f-e7dbd3b23ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14c2bdac-30a5-4a8a-ad91-191c529f77df", "name": "network-vif-deleted", "tag": "f8bb92b2-35e5-484a-adc2-f6309c059f45"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:14.475211 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-8a42a0ef-3b99-4937-85b0-afc0f6ecbb40 req-ec9b540a-14bd-4411-9b5f-e7dbd3b23ca9 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:14.475691 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-8a42a0ef-3b99-4937-85b0-afc0f6ecbb40 req-ec9b540a-14bd-4411-9b5f-e7dbd3b23ca9 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:14.479404 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-8a42a0ef-3b99-4937-85b0-afc0f6ecbb40 req-ec9b540a-14bd-4411-9b5f-e7dbd3b23ca9 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:14.487311 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-8a42a0ef-3b99-4937-85b0-afc0f6ecbb40 req-ec9b540a-14bd-4411-9b5f-e7dbd3b23ca9 service nova] Creating event network-vif-deleted:f8bb92b2-35e5-484a-adc2-f6309c059f45 for instance 14c2bdac-30a5-4a8a-ad91-191c529f77df on hv-cinder-85530 Sep 23 15:26:14.492332 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-8a42a0ef-3b99-4937-85b0-afc0f6ecbb40 req-ec9b540a-14bd-4411-9b5f-e7dbd3b23ca9 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041291 Sep 23 15:26:14.493280 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 371/752] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:26:14.514900 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-7b86b39a-132e-4ad9-ad88-2feb8a3b1114 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:14.515556 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-7b86b39a-132e-4ad9-ad88-2feb8a3b1114 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:14.522087 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7b86b39a-132e-4ad9-ad88-2feb8a3b1114 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:14.522615 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7b86b39a-132e-4ad9-ad88-2feb8a3b1114 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:14.523227 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7b86b39a-132e-4ad9-ad88-2feb8a3b1114 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:14.524222 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7b86b39a-132e-4ad9-ad88-2feb8a3b1114 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:14.525472 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7b86b39a-132e-4ad9-ad88-2feb8a3b1114 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:14.525907 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7b86b39a-132e-4ad9-ad88-2feb8a3b1114 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:14.683654 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-7b86b39a-132e-4ad9-ad88-2feb8a3b1114 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:14.697251 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-7b86b39a-132e-4ad9-ad88-2feb8a3b1114 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1576 microversion: 2.1 time: 0.187105 Sep 23 15:26:14.712267 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 382/753] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:14 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1576 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:15.010306 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-53abc73f-9fd6-4161-b08d-f98c34f6d9c2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:15.010953 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-53abc73f-9fd6-4161-b08d-f98c34f6d9c2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:15.018925 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-53abc73f-9fd6-4161-b08d-f98c34f6d9c2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:15.019132 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-53abc73f-9fd6-4161-b08d-f98c34f6d9c2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:15.019772 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-53abc73f-9fd6-4161-b08d-f98c34f6d9c2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:15.020506 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-53abc73f-9fd6-4161-b08d-f98c34f6d9c2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:15.020966 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-53abc73f-9fd6-4161-b08d-f98c34f6d9c2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:15.021403 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-53abc73f-9fd6-4161-b08d-f98c34f6d9c2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:15.173007 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-53abc73f-9fd6-4161-b08d-f98c34f6d9c2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:15.181828 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-53abc73f-9fd6-4161-b08d-f98c34f6d9c2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:15.183282 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-53abc73f-9fd6-4161-b08d-f98c34f6d9c2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:15.189575 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-53abc73f-9fd6-4161-b08d-f98c34f6d9c2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1723 microversion: 2.20 time: 0.178521 Sep 23 15:26:15.189575 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 372/754] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:15 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:15.480603 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-253bb78e-05c7-443b-87ca-03c0733e3ee6 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:15.481263 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-253bb78e-05c7-443b-87ca-03c0733e3ee6 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:15.488111 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-253bb78e-05c7-443b-87ca-03c0733e3ee6 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:15.488598 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-253bb78e-05c7-443b-87ca-03c0733e3ee6 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:15.489034 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-253bb78e-05c7-443b-87ca-03c0733e3ee6 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:15.489729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-253bb78e-05c7-443b-87ca-03c0733e3ee6 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:15.490175 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-253bb78e-05c7-443b-87ca-03c0733e3ee6 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:15.490634 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-253bb78e-05c7-443b-87ca-03c0733e3ee6 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:15.523165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-253bb78e-05c7-443b-87ca-03c0733e3ee6 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:15.523670 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-253bb78e-05c7-443b-87ca-03c0733e3ee6 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:15.524131 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-253bb78e-05c7-443b-87ca-03c0733e3ee6 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:15.524577 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.objects.instance [None req-253bb78e-05c7-443b-87ca-03c0733e3ee6 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lazy-loading 'fault' on Instance uuid 14c2bdac-30a5-4a8a-ad91-191c529f77df {{(pid=121450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:26:15.576042 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-253bb78e-05c7-443b-87ca-03c0733e3ee6 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deda513f4c6448368cfa79203cf0d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbab8ef4fbd4c61811d0fc046290937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:15.584502 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-253bb78e-05c7-443b-87ca-03c0733e3ee6 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 200 len: 1348 microversion: 2.1 time: 0.107629 Sep 23 15:26:15.585252 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 383/755] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:15 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 1348 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:15.724838 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-795e2a47-0c41-4508-ac73-0f300e0b2333 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:15.725425 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-795e2a47-0c41-4508-ac73-0f300e0b2333 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:15.731564 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:15.736616 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-795e2a47-0c41-4508-ac73-0f300e0b2333 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:15.737305 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-795e2a47-0c41-4508-ac73-0f300e0b2333 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:15.737741 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-795e2a47-0c41-4508-ac73-0f300e0b2333 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:15.738601 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-795e2a47-0c41-4508-ac73-0f300e0b2333 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:15.739221 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-795e2a47-0c41-4508-ac73-0f300e0b2333 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:15.739652 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-795e2a47-0c41-4508-ac73-0f300e0b2333 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:15.884377 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-795e2a47-0c41-4508-ac73-0f300e0b2333 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:15.892696 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-795e2a47-0c41-4508-ac73-0f300e0b2333 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1576 microversion: 2.1 time: 0.173014 Sep 23 15:26:15.893280 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 373/756] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:15 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:16.210206 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-7a4e054f-7d3a-4b2f-aa34-dfc1f76df5f6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:16.210818 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-7a4e054f-7d3a-4b2f-aa34-dfc1f76df5f6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:16.216622 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7a4e054f-7d3a-4b2f-aa34-dfc1f76df5f6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:16.217802 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7a4e054f-7d3a-4b2f-aa34-dfc1f76df5f6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:16.218244 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7a4e054f-7d3a-4b2f-aa34-dfc1f76df5f6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:16.218941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7a4e054f-7d3a-4b2f-aa34-dfc1f76df5f6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:16.219392 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7a4e054f-7d3a-4b2f-aa34-dfc1f76df5f6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:16.219812 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7a4e054f-7d3a-4b2f-aa34-dfc1f76df5f6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:16.353291 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-7a4e054f-7d3a-4b2f-aa34-dfc1f76df5f6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:16.361483 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-7a4e054f-7d3a-4b2f-aa34-dfc1f76df5f6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:16.362900 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-7a4e054f-7d3a-4b2f-aa34-dfc1f76df5f6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:16.364096 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-7a4e054f-7d3a-4b2f-aa34-dfc1f76df5f6 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1723 microversion: 2.20 time: 0.157939 Sep 23 15:26:16.364666 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 384/757] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:16 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:16.608696 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-b17f69fb-e391-4d29-9897-796c2e88afba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:16.609511 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-b17f69fb-e391-4d29-9897-796c2e88afba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] [instance: 14c2bdac-30a5-4a8a-ad91-191c529f77df] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:16.615609 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b17f69fb-e391-4d29-9897-796c2e88afba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:16.616119 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b17f69fb-e391-4d29-9897-796c2e88afba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:16.616557 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b17f69fb-e391-4d29-9897-796c2e88afba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:16.617243 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b17f69fb-e391-4d29-9897-796c2e88afba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:16.617692 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b17f69fb-e391-4d29-9897-796c2e88afba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:16.618114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b17f69fb-e391-4d29-9897-796c2e88afba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:16.632337 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.wsgi [None req-b17f69fb-e391-4d29-9897-796c2e88afba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] HTTP exception thrown: Instance 14c2bdac-30a5-4a8a-ad91-191c529f77df could not be found. Sep 23 15:26:16.633978 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-b17f69fb-e391-4d29-9897-796c2e88afba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Request method failure captured: Sep 23 15:26:16.633978 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: request: GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df HTTP/1.1 Sep 23 15:26:16.633978 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept: application/json Sep 23 15:26:16.633978 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept-Encoding: identity Sep 23 15:26:16.633978 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Connection: close Sep 23 15:26:16.633978 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Length: 0 Sep 23 15:26:16.633978 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Type: application/json Sep 23 15:26:16.633978 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Host: 10.222.0.55 Sep 23 15:26:16.633978 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Openstack-System-Scope: None Sep 23 15:26:16.633978 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: User-Agent: python-urllib3/1.26.12 Sep 23 15:26:16.633978 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Auth-Token: gAAAAABjLc9x4yFRhsibLSorJdZO6mepLeBRSv147O0ymmBFT22aWYs72B4C3R6UTZ9fYvGBx0TBTtssMpGFgSmLfaMkQYgUE7N_cKZ7GjhStBR3CUVSOv5ciBCNGN9LZgYCPpbl4mdD7MBA9uBlUbKJFSo7equyuRtjVL8xV7MNsaolQ7a79Fo Sep 23 15:26:16.633978 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Id: None Sep 23 15:26:16.633978 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Name: None Sep 23 15:26:16.633978 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Identity-Status: Confirmed Sep 23 15:26:16.633978 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Is-Admin-Project: True Sep 23 15:26:16.633978 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Id: default Sep 23 15:26:16.633978 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Name: Default Sep 23 15:26:16.633978 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Id: efbab8ef4fbd4c61811d0fc046290937 Sep 23 15:26:16.633978 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Name: tempest-TestMinimumBasicScenario-140355407 Sep 23 15:26:16.633978 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Role: reader,member Sep 23 15:26:16.633978 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Roles: reader,member Sep 23 15:26:16.635567 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/efbab8ef4fbd4c61811d0fc046290937"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/efbab8ef4fbd4c61811d0fc046290937"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_efbab8ef4fbd4c61811d0fc046290937", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/efbab8ef4fbd4c61811d0fc046290937"}]}] Sep 23 15:26:16.635567 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant: tempest-TestMinimumBasicScenario-140355407 Sep 23 15:26:16.635567 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Id: efbab8ef4fbd4c61811d0fc046290937 Sep 23 15:26:16.635567 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Name: tempest-TestMinimumBasicScenario-140355407 Sep 23 15:26:16.635567 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User: tempest-TestMinimumBasicScenario-140355407-project Sep 23 15:26:16.635567 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Id: default Sep 23 15:26:16.635567 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Name: Default Sep 23 15:26:16.635567 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Id: deda513f4c6448368cfa79203cf0d8d8 Sep 23 15:26:16.635567 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Name: tempest-TestMinimumBasicScenario-140355407-project Sep 23 15:26:16.635567 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: method: > Sep 23 15:26:16.635567 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: exception: Instance 14c2bdac-30a5-4a8a-ad91-191c529f77df could not be found. Sep 23 15:26:16.635567 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: action_args: {'id': '14c2bdac-30a5-4a8a-ad91-191c529f77df'} Sep 23 15:26:16.636541 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:26:16.636541 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:16.636541 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:26:16.636541 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:26:16.636541 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:26:16.636541 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:26:16.636541 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:26:16.636541 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:26:16.636541 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:26:16.636541 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:26:16.636541 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14c2bdac-30a5-4a8a-ad91-191c529f77df could not be found. Sep 23 15:26:16.636541 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:26:16.636541 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:26:16.636541 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:26:16.636541 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:16.636541 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:26:16.636541 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:26:16.636541 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:26:16.636541 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:26:16.636541 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:26:16.638188 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:26:16.638188 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:26:16.638188 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:26:16.638188 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:26:16.638188 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:26:16.638188 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:26:16.638188 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:26:16.638188 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14c2bdac-30a5-4a8a-ad91-191c529f77df could not be found. Sep 23 15:26:16.638188 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:26:16.638188 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:26:16.638188 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:26:16.638188 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:16.638188 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:26:16.638188 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:26:16.638188 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:26:16.638188 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:26:16.638188 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14c2bdac-30a5-4a8a-ad91-191c529f77df could not be found. Sep 23 15:26:16.638188 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:26:16.640812 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-b17f69fb-e391-4d29-9897-796c2e88afba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Returning 404 to user: Instance 14c2bdac-30a5-4a8a-ad91-191c529f77df could not be found. {{(pid=121448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:26:16.640812 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-b17f69fb-e391-4d29-9897-796c2e88afba tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df" status: 404 len: 111 microversion: 2.1 time: 0.031649 Sep 23 15:26:16.640812 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 374/758] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:16 2022] GET /compute/v2.1/servers/14c2bdac-30a5-4a8a-ad91-191c529f77df => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:26:16.645185 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-16494c39-e22c-436d-a7cd-c989a0ee8570 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] Calling method '.version_select at 0x7f82db85ce50>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:16.726992 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-16494c39-e22c-436d-a7cd-c989a0ee8570 tempest-TestMinimumBasicScenario-140355407 tempest-TestMinimumBasicScenario-140355407-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1577171453" status: 202 len: 0 microversion: 2.1 time: 0.085452 Sep 23 15:26:16.727589 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 385/759] 10.222.0.55 () {58 vars in 1272 bytes} [Fri Sep 23 15:26:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1577171453 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 15:26:16.925799 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-3a702c05-5650-4378-88b0-87c0ac2a3112 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:16.927045 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-3a702c05-5650-4378-88b0-87c0ac2a3112 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:16.934251 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3a702c05-5650-4378-88b0-87c0ac2a3112 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:16.934736 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3a702c05-5650-4378-88b0-87c0ac2a3112 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:16.935390 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3a702c05-5650-4378-88b0-87c0ac2a3112 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:16.936246 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3a702c05-5650-4378-88b0-87c0ac2a3112 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:16.936920 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3a702c05-5650-4378-88b0-87c0ac2a3112 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:16.937347 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3a702c05-5650-4378-88b0-87c0ac2a3112 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:17.082436 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-3a702c05-5650-4378-88b0-87c0ac2a3112 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:17.092536 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-3a702c05-5650-4378-88b0-87c0ac2a3112 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1576 microversion: 2.1 time: 0.171069 Sep 23 15:26:17.093209 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 375/760] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:16 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:17.397938 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-7f721693-4e25-4e63-bfcb-efe40658ba23 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:17.398529 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-7f721693-4e25-4e63-bfcb-efe40658ba23 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:17.405317 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7f721693-4e25-4e63-bfcb-efe40658ba23 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:17.406026 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7f721693-4e25-4e63-bfcb-efe40658ba23 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:17.406509 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7f721693-4e25-4e63-bfcb-efe40658ba23 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:17.407293 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7f721693-4e25-4e63-bfcb-efe40658ba23 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:17.407777 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7f721693-4e25-4e63-bfcb-efe40658ba23 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:17.408387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7f721693-4e25-4e63-bfcb-efe40658ba23 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:17.554710 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-7f721693-4e25-4e63-bfcb-efe40658ba23 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:17.563474 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-7f721693-4e25-4e63-bfcb-efe40658ba23 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:17.564990 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-7f721693-4e25-4e63-bfcb-efe40658ba23 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:17.566239 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-7f721693-4e25-4e63-bfcb-efe40658ba23 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1723 microversion: 2.20 time: 0.172542 Sep 23 15:26:17.566794 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 386/761] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:17 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:18.187242 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-bd3eab6f-d1d7-4fa2-9225-cfa7e906ca07 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:18.187861 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-bd3eab6f-d1d7-4fa2-9225-cfa7e906ca07 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:18.194610 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bd3eab6f-d1d7-4fa2-9225-cfa7e906ca07 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:18.195100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bd3eab6f-d1d7-4fa2-9225-cfa7e906ca07 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:18.195543 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bd3eab6f-d1d7-4fa2-9225-cfa7e906ca07 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:18.196278 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bd3eab6f-d1d7-4fa2-9225-cfa7e906ca07 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:18.196734 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bd3eab6f-d1d7-4fa2-9225-cfa7e906ca07 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:18.197169 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bd3eab6f-d1d7-4fa2-9225-cfa7e906ca07 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:18.337264 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-bd3eab6f-d1d7-4fa2-9225-cfa7e906ca07 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:18.345270 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-bd3eab6f-d1d7-4fa2-9225-cfa7e906ca07 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1576 microversion: 2.1 time: 0.162608 Sep 23 15:26:18.345853 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 376/762] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:18 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:18.591925 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-c5d12b27-dc8a-4640-ad9f-059e5bba55e8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:18.593099 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-c5d12b27-dc8a-4640-ad9f-059e5bba55e8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:18.600285 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c5d12b27-dc8a-4640-ad9f-059e5bba55e8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:18.600777 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c5d12b27-dc8a-4640-ad9f-059e5bba55e8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:18.601216 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c5d12b27-dc8a-4640-ad9f-059e5bba55e8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:18.601912 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c5d12b27-dc8a-4640-ad9f-059e5bba55e8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:18.602416 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c5d12b27-dc8a-4640-ad9f-059e5bba55e8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:18.602876 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c5d12b27-dc8a-4640-ad9f-059e5bba55e8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:18.802433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-c5d12b27-dc8a-4640-ad9f-059e5bba55e8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:18.810891 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-c5d12b27-dc8a-4640-ad9f-059e5bba55e8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:18.813021 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-c5d12b27-dc8a-4640-ad9f-059e5bba55e8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:18.814420 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-c5d12b27-dc8a-4640-ad9f-059e5bba55e8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1723 microversion: 2.20 time: 0.226849 Sep 23 15:26:18.815306 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 387/763] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:18 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:19.370291 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-e7293fdf-0092-40cc-884e-5b986cb51837 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:19.370900 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-e7293fdf-0092-40cc-884e-5b986cb51837 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:19.377713 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e7293fdf-0092-40cc-884e-5b986cb51837 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:19.381382 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e7293fdf-0092-40cc-884e-5b986cb51837 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:19.381382 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e7293fdf-0092-40cc-884e-5b986cb51837 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:19.381382 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e7293fdf-0092-40cc-884e-5b986cb51837 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:19.381382 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e7293fdf-0092-40cc-884e-5b986cb51837 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:19.381818 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e7293fdf-0092-40cc-884e-5b986cb51837 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:19.596853 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-e7293fdf-0092-40cc-884e-5b986cb51837 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:19.605493 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-e7293fdf-0092-40cc-884e-5b986cb51837 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1576 microversion: 2.1 time: 0.239018 Sep 23 15:26:19.606160 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 377/764] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:19 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1576 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:19.840467 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-87324096-d6b9-4ca2-811a-f192483665fd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:19.841101 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-87324096-d6b9-4ca2-811a-f192483665fd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:19.848168 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-87324096-d6b9-4ca2-811a-f192483665fd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:19.848652 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-87324096-d6b9-4ca2-811a-f192483665fd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:19.849083 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-87324096-d6b9-4ca2-811a-f192483665fd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:19.849771 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-87324096-d6b9-4ca2-811a-f192483665fd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:19.850215 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-87324096-d6b9-4ca2-811a-f192483665fd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:19.850631 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-87324096-d6b9-4ca2-811a-f192483665fd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:20.003695 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-87324096-d6b9-4ca2-811a-f192483665fd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:20.013580 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-87324096-d6b9-4ca2-811a-f192483665fd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:20.018993 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-87324096-d6b9-4ca2-811a-f192483665fd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:20.020563 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-87324096-d6b9-4ca2-811a-f192483665fd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1723 microversion: 2.20 time: 0.183926 Sep 23 15:26:20.040425 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 388/765] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:19 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:20.629937 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-7b8c2f7a-7bf1-4064-a139-4204fe3e28ec tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:20.631183 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-7b8c2f7a-7bf1-4064-a139-4204fe3e28ec tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:20.638540 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7b8c2f7a-7bf1-4064-a139-4204fe3e28ec tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:20.639799 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7b8c2f7a-7bf1-4064-a139-4204fe3e28ec tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:20.640438 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7b8c2f7a-7bf1-4064-a139-4204fe3e28ec tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:20.641360 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7b8c2f7a-7bf1-4064-a139-4204fe3e28ec tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:20.641939 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7b8c2f7a-7bf1-4064-a139-4204fe3e28ec tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:20.642226 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7b8c2f7a-7bf1-4064-a139-4204fe3e28ec tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:20.848702 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-7b8c2f7a-7bf1-4064-a139-4204fe3e28ec tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:20.856679 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-7b8c2f7a-7bf1-4064-a139-4204fe3e28ec tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1576 microversion: 2.1 time: 0.230541 Sep 23 15:26:20.857258 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 378/766] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:20 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1576 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:21.051791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a1ddda18-f8d1-465d-82ce-ea6797dae5a4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:21.061689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-a1ddda18-f8d1-465d-82ce-ea6797dae5a4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:21.075528 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a1ddda18-f8d1-465d-82ce-ea6797dae5a4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:21.081539 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a1ddda18-f8d1-465d-82ce-ea6797dae5a4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:21.082249 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a1ddda18-f8d1-465d-82ce-ea6797dae5a4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:21.083587 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a1ddda18-f8d1-465d-82ce-ea6797dae5a4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:21.085509 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a1ddda18-f8d1-465d-82ce-ea6797dae5a4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:21.093450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a1ddda18-f8d1-465d-82ce-ea6797dae5a4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:21.454742 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a1ddda18-f8d1-465d-82ce-ea6797dae5a4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:21.466462 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a1ddda18-f8d1-465d-82ce-ea6797dae5a4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:21.466462 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a1ddda18-f8d1-465d-82ce-ea6797dae5a4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:21.466967 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-a1ddda18-f8d1-465d-82ce-ea6797dae5a4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1723 microversion: 2.20 time: 0.419129 Sep 23 15:26:21.468479 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 389/767] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:21 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1723 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:21.885491 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-30bbf9bf-fb5b-4f83-998b-091507b463a1 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:21.886773 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-30bbf9bf-fb5b-4f83-998b-091507b463a1 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:21.898756 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-30bbf9bf-fb5b-4f83-998b-091507b463a1 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:21.899540 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-30bbf9bf-fb5b-4f83-998b-091507b463a1 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:21.900271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-30bbf9bf-fb5b-4f83-998b-091507b463a1 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:21.900983 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-30bbf9bf-fb5b-4f83-998b-091507b463a1 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:21.901437 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-30bbf9bf-fb5b-4f83-998b-091507b463a1 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:21.901887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-30bbf9bf-fb5b-4f83-998b-091507b463a1 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:22.067920 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-30bbf9bf-fb5b-4f83-998b-091507b463a1 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:22.079171 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-30bbf9bf-fb5b-4f83-998b-091507b463a1 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1576 microversion: 2.1 time: 0.200763 Sep 23 15:26:22.079760 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 379/768] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:21 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1576 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:22.495556 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-fde63172-ac2b-4a51-8b6c-8eded616df4f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:22.496943 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-fde63172-ac2b-4a51-8b6c-8eded616df4f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:22.504840 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fde63172-ac2b-4a51-8b6c-8eded616df4f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:22.505237 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fde63172-ac2b-4a51-8b6c-8eded616df4f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:22.505626 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fde63172-ac2b-4a51-8b6c-8eded616df4f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:22.506331 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fde63172-ac2b-4a51-8b6c-8eded616df4f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:22.506783 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fde63172-ac2b-4a51-8b6c-8eded616df4f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:22.507203 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fde63172-ac2b-4a51-8b6c-8eded616df4f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:22.682981 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-fde63172-ac2b-4a51-8b6c-8eded616df4f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:22.692253 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-fde63172-ac2b-4a51-8b6c-8eded616df4f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:22.693681 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-fde63172-ac2b-4a51-8b6c-8eded616df4f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:22.694835 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-fde63172-ac2b-4a51-8b6c-8eded616df4f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1723 microversion: 2.20 time: 0.204314 Sep 23 15:26:22.695708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 390/769] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:22 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:26:23.106430 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-f2cd136a-4969-4368-8731-b3cba6756bf3 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:23.107046 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-f2cd136a-4969-4368-8731-b3cba6756bf3 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:23.113343 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f2cd136a-4969-4368-8731-b3cba6756bf3 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:23.114089 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f2cd136a-4969-4368-8731-b3cba6756bf3 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:23.114708 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f2cd136a-4969-4368-8731-b3cba6756bf3 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:23.115406 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f2cd136a-4969-4368-8731-b3cba6756bf3 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:23.115864 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f2cd136a-4969-4368-8731-b3cba6756bf3 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:23.116321 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f2cd136a-4969-4368-8731-b3cba6756bf3 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:23.292683 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-f2cd136a-4969-4368-8731-b3cba6756bf3 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:23.304150 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-f2cd136a-4969-4368-8731-b3cba6756bf3 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1576 microversion: 2.1 time: 0.199833 Sep 23 15:26:23.314157 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 380/770] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:23 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1576 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:23.721549 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-eb7e5a2a-6213-4eba-b72b-87a64282cbed tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:23.722149 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-eb7e5a2a-6213-4eba-b72b-87a64282cbed tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:23.728767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eb7e5a2a-6213-4eba-b72b-87a64282cbed tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:23.729180 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eb7e5a2a-6213-4eba-b72b-87a64282cbed tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:23.729609 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eb7e5a2a-6213-4eba-b72b-87a64282cbed tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:23.730294 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eb7e5a2a-6213-4eba-b72b-87a64282cbed tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:23.730765 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eb7e5a2a-6213-4eba-b72b-87a64282cbed tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:23.731187 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-eb7e5a2a-6213-4eba-b72b-87a64282cbed tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:23.966783 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-eb7e5a2a-6213-4eba-b72b-87a64282cbed tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:23.977624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-eb7e5a2a-6213-4eba-b72b-87a64282cbed tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:23.979189 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-eb7e5a2a-6213-4eba-b72b-87a64282cbed tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:23.980444 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-eb7e5a2a-6213-4eba-b72b-87a64282cbed tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1723 microversion: 2.20 time: 0.263020 Sep 23 15:26:23.981006 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 391/771] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:23 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:24.329413 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6be92711-eaf2-4c9c-9dcd-58b8e872c589 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:24.330576 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-6be92711-eaf2-4c9c-9dcd-58b8e872c589 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:24.336826 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6be92711-eaf2-4c9c-9dcd-58b8e872c589 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:24.337522 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6be92711-eaf2-4c9c-9dcd-58b8e872c589 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:24.337962 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6be92711-eaf2-4c9c-9dcd-58b8e872c589 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:24.338658 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6be92711-eaf2-4c9c-9dcd-58b8e872c589 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:24.339110 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6be92711-eaf2-4c9c-9dcd-58b8e872c589 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:24.339717 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6be92711-eaf2-4c9c-9dcd-58b8e872c589 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:24.530282 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6be92711-eaf2-4c9c-9dcd-58b8e872c589 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:24.542900 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-6be92711-eaf2-4c9c-9dcd-58b8e872c589 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1576 microversion: 2.1 time: 0.217484 Sep 23 15:26:24.544455 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 381/772] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:24 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1576 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:25.008346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-4b4dec75-775f-45f1-9ec1-f7e2746e4ff8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:25.009662 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-4b4dec75-775f-45f1-9ec1-f7e2746e4ff8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:25.017589 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4b4dec75-775f-45f1-9ec1-f7e2746e4ff8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:25.018096 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4b4dec75-775f-45f1-9ec1-f7e2746e4ff8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:25.018694 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4b4dec75-775f-45f1-9ec1-f7e2746e4ff8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:25.019723 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4b4dec75-775f-45f1-9ec1-f7e2746e4ff8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:25.020261 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4b4dec75-775f-45f1-9ec1-f7e2746e4ff8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:25.020700 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4b4dec75-775f-45f1-9ec1-f7e2746e4ff8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:25.222286 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-4b4dec75-775f-45f1-9ec1-f7e2746e4ff8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:25.238934 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-4b4dec75-775f-45f1-9ec1-f7e2746e4ff8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:25.241567 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-4b4dec75-775f-45f1-9ec1-f7e2746e4ff8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:25.243742 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-4b4dec75-775f-45f1-9ec1-f7e2746e4ff8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1723 microversion: 2.20 time: 0.239528 Sep 23 15:26:25.245074 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 392/773] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:25 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:25.576119 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-b2f19582-ae4b-4ce8-ab7b-4e0777f70490 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:25.580094 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-b2f19582-ae4b-4ce8-ab7b-4e0777f70490 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:25.588329 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b2f19582-ae4b-4ce8-ab7b-4e0777f70490 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:25.589303 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b2f19582-ae4b-4ce8-ab7b-4e0777f70490 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:25.589933 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b2f19582-ae4b-4ce8-ab7b-4e0777f70490 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:25.590895 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b2f19582-ae4b-4ce8-ab7b-4e0777f70490 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:25.593636 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b2f19582-ae4b-4ce8-ab7b-4e0777f70490 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:25.594339 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b2f19582-ae4b-4ce8-ab7b-4e0777f70490 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:25.846742 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b2f19582-ae4b-4ce8-ab7b-4e0777f70490 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:25.858785 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-b2f19582-ae4b-4ce8-ab7b-4e0777f70490 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1576 microversion: 2.1 time: 0.290561 Sep 23 15:26:25.860177 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 382/774] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:25 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1576 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:26.276291 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-985f73cf-25ab-4f8d-8a63-cc8417bc7d83 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:26.277440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-985f73cf-25ab-4f8d-8a63-cc8417bc7d83 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:26.286240 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-985f73cf-25ab-4f8d-8a63-cc8417bc7d83 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:26.286876 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-985f73cf-25ab-4f8d-8a63-cc8417bc7d83 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:26.287415 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-985f73cf-25ab-4f8d-8a63-cc8417bc7d83 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:26.288248 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-985f73cf-25ab-4f8d-8a63-cc8417bc7d83 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:26.288893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-985f73cf-25ab-4f8d-8a63-cc8417bc7d83 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:26.289387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-985f73cf-25ab-4f8d-8a63-cc8417bc7d83 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:26.447065 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-985f73cf-25ab-4f8d-8a63-cc8417bc7d83 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:26.458870 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-985f73cf-25ab-4f8d-8a63-cc8417bc7d83 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:26.461607 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-985f73cf-25ab-4f8d-8a63-cc8417bc7d83 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:26.463019 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-985f73cf-25ab-4f8d-8a63-cc8417bc7d83 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1723 microversion: 2.20 time: 0.191956 Sep 23 15:26:26.493642 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 393/775] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:26 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:26.670905 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-44436d82-e4d8-4372-a935-8059fff3c6c9 req-e9688063-302d-477d-971f-f0748cfcaa46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74b48a2a-0dde-4289-b8d6-788a66dafddb", "name": "network-vif-plugged", "status": "completed", "tag": "0c8439ba-0b08-4cad-8937-aa360e2a93ed"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:26.681292 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-44436d82-e4d8-4372-a935-8059fff3c6c9 req-e9688063-302d-477d-971f-f0748cfcaa46 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:26.681774 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-44436d82-e4d8-4372-a935-8059fff3c6c9 req-e9688063-302d-477d-971f-f0748cfcaa46 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:26.682207 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-44436d82-e4d8-4372-a935-8059fff3c6c9 req-e9688063-302d-477d-971f-f0748cfcaa46 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:26.694013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-44436d82-e4d8-4372-a935-8059fff3c6c9 req-e9688063-302d-477d-971f-f0748cfcaa46 service nova] Creating event network-vif-plugged:0c8439ba-0b08-4cad-8937-aa360e2a93ed for instance 74b48a2a-0dde-4289-b8d6-788a66dafddb on hv-cinder-85530 Sep 23 15:26:26.699218 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-44436d82-e4d8-4372-a935-8059fff3c6c9 req-e9688063-302d-477d-971f-f0748cfcaa46 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032048 Sep 23 15:26:26.699803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 383/776] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:26:26.886818 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a68ca95d-60ef-4de5-8ce3-4e20b65a688b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:26.887493 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-a68ca95d-60ef-4de5-8ce3-4e20b65a688b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:26.904361 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a68ca95d-60ef-4de5-8ce3-4e20b65a688b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:26.905138 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a68ca95d-60ef-4de5-8ce3-4e20b65a688b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:26.905918 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a68ca95d-60ef-4de5-8ce3-4e20b65a688b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:26.907671 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a68ca95d-60ef-4de5-8ce3-4e20b65a688b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:26.908460 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a68ca95d-60ef-4de5-8ce3-4e20b65a688b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:26.909217 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a68ca95d-60ef-4de5-8ce3-4e20b65a688b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:27.471219 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a68ca95d-60ef-4de5-8ce3-4e20b65a688b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:27.483472 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-a68ca95d-60ef-4de5-8ce3-4e20b65a688b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1576 microversion: 2.1 time: 0.600100 Sep 23 15:26:27.488933 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 394/777] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:26 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1576 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:27.502132 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-c08eab9d-4334-4009-871f-eb39f5bdb434 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:27.503147 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-c08eab9d-4334-4009-871f-eb39f5bdb434 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:27.512992 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c08eab9d-4334-4009-871f-eb39f5bdb434 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:27.514463 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c08eab9d-4334-4009-871f-eb39f5bdb434 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:27.515296 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c08eab9d-4334-4009-871f-eb39f5bdb434 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:27.516486 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c08eab9d-4334-4009-871f-eb39f5bdb434 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:27.516957 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c08eab9d-4334-4009-871f-eb39f5bdb434 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:27.517387 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c08eab9d-4334-4009-871f-eb39f5bdb434 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:27.736768 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-c08eab9d-4334-4009-871f-eb39f5bdb434 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:27.746993 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-c08eab9d-4334-4009-871f-eb39f5bdb434 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:27.750408 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-c08eab9d-4334-4009-871f-eb39f5bdb434 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:27.751721 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-c08eab9d-4334-4009-871f-eb39f5bdb434 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1723 microversion: 2.20 time: 0.254562 Sep 23 15:26:27.752411 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 384/778] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:27 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:28.509424 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-0124f199-48ba-4aa4-a6d5-c0ef6722a46f tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:28.510120 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-0124f199-48ba-4aa4-a6d5-c0ef6722a46f tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:28.517793 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0124f199-48ba-4aa4-a6d5-c0ef6722a46f tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:28.518616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0124f199-48ba-4aa4-a6d5-c0ef6722a46f tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:28.519059 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0124f199-48ba-4aa4-a6d5-c0ef6722a46f tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:28.520013 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0124f199-48ba-4aa4-a6d5-c0ef6722a46f tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:28.520658 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0124f199-48ba-4aa4-a6d5-c0ef6722a46f tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:28.521264 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0124f199-48ba-4aa4-a6d5-c0ef6722a46f tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:28.547673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=100 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:28.689178 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-0124f199-48ba-4aa4-a6d5-c0ef6722a46f tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:28.697903 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-0124f199-48ba-4aa4-a6d5-c0ef6722a46f tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1576 microversion: 2.1 time: 0.192621 Sep 23 15:26:28.698499 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 395/779] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:28 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1576 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:28.780564 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-9b1951d1-011c-4546-8bbb-d9f57b02f84a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:28.782509 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-9b1951d1-011c-4546-8bbb-d9f57b02f84a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:28.789075 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9b1951d1-011c-4546-8bbb-d9f57b02f84a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:28.789610 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9b1951d1-011c-4546-8bbb-d9f57b02f84a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:28.790229 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9b1951d1-011c-4546-8bbb-d9f57b02f84a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:28.791400 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9b1951d1-011c-4546-8bbb-d9f57b02f84a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:28.791895 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9b1951d1-011c-4546-8bbb-d9f57b02f84a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:28.792445 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9b1951d1-011c-4546-8bbb-d9f57b02f84a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:28.956714 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-9b1951d1-011c-4546-8bbb-d9f57b02f84a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:28.960210 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=100 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:28.966004 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-9b1951d1-011c-4546-8bbb-d9f57b02f84a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:28.968064 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-9b1951d1-011c-4546-8bbb-d9f57b02f84a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:28.969457 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-9b1951d1-011c-4546-8bbb-d9f57b02f84a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1744 microversion: 2.20 time: 0.194682 Sep 23 15:26:28.970223 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 385/780] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:28 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1744 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:29.725615 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-f4850e71-1b0e-429e-8ef2-5ccf9057de0a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:29.726229 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-f4850e71-1b0e-429e-8ef2-5ccf9057de0a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:29.733353 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f4850e71-1b0e-429e-8ef2-5ccf9057de0a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:29.733843 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f4850e71-1b0e-429e-8ef2-5ccf9057de0a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:29.734299 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f4850e71-1b0e-429e-8ef2-5ccf9057de0a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:29.735037 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f4850e71-1b0e-429e-8ef2-5ccf9057de0a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:29.735492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f4850e71-1b0e-429e-8ef2-5ccf9057de0a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:29.736033 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f4850e71-1b0e-429e-8ef2-5ccf9057de0a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:29.882118 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-f4850e71-1b0e-429e-8ef2-5ccf9057de0a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:29.893023 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-f4850e71-1b0e-429e-8ef2-5ccf9057de0a tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1563 microversion: 2.1 time: 0.171640 Sep 23 15:26:29.893907 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 396/781] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:29 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:29.994858 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6e271654-a397-4aca-b923-cefdd8ff83e4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:29.995473 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-6e271654-a397-4aca-b923-cefdd8ff83e4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:30.004267 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6e271654-a397-4aca-b923-cefdd8ff83e4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:30.004757 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6e271654-a397-4aca-b923-cefdd8ff83e4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:30.006840 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6e271654-a397-4aca-b923-cefdd8ff83e4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:30.006840 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6e271654-a397-4aca-b923-cefdd8ff83e4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:30.006840 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6e271654-a397-4aca-b923-cefdd8ff83e4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:30.006840 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6e271654-a397-4aca-b923-cefdd8ff83e4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:30.149356 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6e271654-a397-4aca-b923-cefdd8ff83e4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:30.157874 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6e271654-a397-4aca-b923-cefdd8ff83e4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:30.162729 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6e271654-a397-4aca-b923-cefdd8ff83e4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:30.163921 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-6e271654-a397-4aca-b923-cefdd8ff83e4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1744 microversion: 2.20 time: 0.173182 Sep 23 15:26:30.164668 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 386/782] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:29 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1744 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:31.191814 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-80a5c894-9e34-4bf8-a464-1f5931ffb802 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:31.193089 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-80a5c894-9e34-4bf8-a464-1f5931ffb802 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:31.200232 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-80a5c894-9e34-4bf8-a464-1f5931ffb802 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:31.225168 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-80a5c894-9e34-4bf8-a464-1f5931ffb802 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:31.225168 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-80a5c894-9e34-4bf8-a464-1f5931ffb802 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:31.225168 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-80a5c894-9e34-4bf8-a464-1f5931ffb802 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:31.225168 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-80a5c894-9e34-4bf8-a464-1f5931ffb802 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:31.226192 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-80a5c894-9e34-4bf8-a464-1f5931ffb802 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:31.367433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-80a5c894-9e34-4bf8-a464-1f5931ffb802 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:31.377172 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-80a5c894-9e34-4bf8-a464-1f5931ffb802 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:31.378572 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-80a5c894-9e34-4bf8-a464-1f5931ffb802 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:31.379757 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-80a5c894-9e34-4bf8-a464-1f5931ffb802 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1739 microversion: 2.20 time: 0.191785 Sep 23 15:26:31.380350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 397/783] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:31 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:32.411239 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a325ae4c-2729-4a02-a729-61d583a7b89f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:32.412699 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-a325ae4c-2729-4a02-a729-61d583a7b89f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:32.419825 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a325ae4c-2729-4a02-a729-61d583a7b89f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:32.421223 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a325ae4c-2729-4a02-a729-61d583a7b89f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:32.421780 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a325ae4c-2729-4a02-a729-61d583a7b89f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:32.422743 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a325ae4c-2729-4a02-a729-61d583a7b89f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:32.423296 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a325ae4c-2729-4a02-a729-61d583a7b89f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:32.423942 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a325ae4c-2729-4a02-a729-61d583a7b89f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:32.629161 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a325ae4c-2729-4a02-a729-61d583a7b89f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:32.643611 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a325ae4c-2729-4a02-a729-61d583a7b89f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:32.649680 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a325ae4c-2729-4a02-a729-61d583a7b89f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:32.651735 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-a325ae4c-2729-4a02-a729-61d583a7b89f tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1739 microversion: 2.20 time: 0.245570 Sep 23 15:26:32.657749 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 387/784] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:32 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1739 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:32.856169 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-a825a970-93ee-4a85-a80e-7b31b9dcc074 req-8106efe3-9cbe-4bd4-a53a-32f11aacc5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46eb43e1-8a8e-4c5e-a071-ef900f024b55", "name": "network-vif-plugged", "status": "completed", "tag": "372595b3-5ccc-49a2-81d3-b61302bfa68d"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:32.876943 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-a825a970-93ee-4a85-a80e-7b31b9dcc074 req-8106efe3-9cbe-4bd4-a53a-32f11aacc5a1 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:32.877459 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-a825a970-93ee-4a85-a80e-7b31b9dcc074 req-8106efe3-9cbe-4bd4-a53a-32f11aacc5a1 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:32.880041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-a825a970-93ee-4a85-a80e-7b31b9dcc074 req-8106efe3-9cbe-4bd4-a53a-32f11aacc5a1 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:32.893348 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-a825a970-93ee-4a85-a80e-7b31b9dcc074 req-8106efe3-9cbe-4bd4-a53a-32f11aacc5a1 service nova] Creating event network-vif-plugged:372595b3-5ccc-49a2-81d3-b61302bfa68d for instance 46eb43e1-8a8e-4c5e-a071-ef900f024b55 on hv-cinder-85530 Sep 23 15:26:32.909100 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-a825a970-93ee-4a85-a80e-7b31b9dcc074 req-8106efe3-9cbe-4bd4-a53a-32f11aacc5a1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056662 Sep 23 15:26:32.910977 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 398/785] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:33.696461 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-9eb4beeb-91ae-4eaf-ba86-fe5166dab8a8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:33.697177 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-9eb4beeb-91ae-4eaf-ba86-fe5166dab8a8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:33.717460 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9eb4beeb-91ae-4eaf-ba86-fe5166dab8a8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:33.727477 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9eb4beeb-91ae-4eaf-ba86-fe5166dab8a8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:33.727477 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9eb4beeb-91ae-4eaf-ba86-fe5166dab8a8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:33.727477 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9eb4beeb-91ae-4eaf-ba86-fe5166dab8a8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:33.727477 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9eb4beeb-91ae-4eaf-ba86-fe5166dab8a8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:33.728026 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9eb4beeb-91ae-4eaf-ba86-fe5166dab8a8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:34.039754 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-9eb4beeb-91ae-4eaf-ba86-fe5166dab8a8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:34.048746 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-9eb4beeb-91ae-4eaf-ba86-fe5166dab8a8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:34.050190 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-9eb4beeb-91ae-4eaf-ba86-fe5166dab8a8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:34.051570 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-9eb4beeb-91ae-4eaf-ba86-fe5166dab8a8 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1739 microversion: 2.20 time: 0.359452 Sep 23 15:26:34.052475 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 388/786] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:33 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1739 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:35.102791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-272faad8-6d02-4a0e-90ce-3e890714d52a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:35.103528 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-272faad8-6d02-4a0e-90ce-3e890714d52a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:35.134069 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-272faad8-6d02-4a0e-90ce-3e890714d52a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:35.134580 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-272faad8-6d02-4a0e-90ce-3e890714d52a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:35.135003 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-272faad8-6d02-4a0e-90ce-3e890714d52a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:35.136187 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-272faad8-6d02-4a0e-90ce-3e890714d52a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:35.136353 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-272faad8-6d02-4a0e-90ce-3e890714d52a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:35.137196 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-272faad8-6d02-4a0e-90ce-3e890714d52a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:35.369213 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-272faad8-6d02-4a0e-90ce-3e890714d52a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:35.381271 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-272faad8-6d02-4a0e-90ce-3e890714d52a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:35.383484 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-272faad8-6d02-4a0e-90ce-3e890714d52a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:35.385359 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-272faad8-6d02-4a0e-90ce-3e890714d52a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1739 microversion: 2.20 time: 0.297461 Sep 23 15:26:35.386638 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 399/787] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:35 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1739 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:36.412482 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6f63414b-78c3-455d-968c-666ed6a8d346 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:36.414036 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-6f63414b-78c3-455d-968c-666ed6a8d346 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:36.422232 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6f63414b-78c3-455d-968c-666ed6a8d346 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:36.424538 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6f63414b-78c3-455d-968c-666ed6a8d346 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:36.424538 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6f63414b-78c3-455d-968c-666ed6a8d346 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:36.424538 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6f63414b-78c3-455d-968c-666ed6a8d346 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:36.424970 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6f63414b-78c3-455d-968c-666ed6a8d346 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:36.425576 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6f63414b-78c3-455d-968c-666ed6a8d346 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:36.664748 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6f63414b-78c3-455d-968c-666ed6a8d346 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:36.681415 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6f63414b-78c3-455d-968c-666ed6a8d346 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:36.683780 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6f63414b-78c3-455d-968c-666ed6a8d346 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:36.685403 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-6f63414b-78c3-455d-968c-666ed6a8d346 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1739 microversion: 2.20 time: 0.276930 Sep 23 15:26:36.700477 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 389/788] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:36 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1739 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:37.712698 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-9ece5ae7-411e-4d15-88d8-b2b1c1562918 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:37.717736 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-9ece5ae7-411e-4d15-88d8-b2b1c1562918 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:37.726973 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:37.728124 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9ece5ae7-411e-4d15-88d8-b2b1c1562918 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:37.728784 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9ece5ae7-411e-4d15-88d8-b2b1c1562918 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:37.729391 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9ece5ae7-411e-4d15-88d8-b2b1c1562918 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:37.730329 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9ece5ae7-411e-4d15-88d8-b2b1c1562918 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:37.730933 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9ece5ae7-411e-4d15-88d8-b2b1c1562918 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:37.731506 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9ece5ae7-411e-4d15-88d8-b2b1c1562918 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:37.980856 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-9ece5ae7-411e-4d15-88d8-b2b1c1562918 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:37.999093 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-9ece5ae7-411e-4d15-88d8-b2b1c1562918 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:38.001036 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-9ece5ae7-411e-4d15-88d8-b2b1c1562918 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:38.005614 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-9ece5ae7-411e-4d15-88d8-b2b1c1562918 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1739 microversion: 2.20 time: 0.296815 Sep 23 15:26:38.006265 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 400/789] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:37 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1739 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:39.037284 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6934a0dc-de8f-459c-bd39-ebd784e78062 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:39.038528 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-6934a0dc-de8f-459c-bd39-ebd784e78062 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:39.054764 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6934a0dc-de8f-459c-bd39-ebd784e78062 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:39.055419 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6934a0dc-de8f-459c-bd39-ebd784e78062 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:39.056507 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6934a0dc-de8f-459c-bd39-ebd784e78062 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:39.058086 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6934a0dc-de8f-459c-bd39-ebd784e78062 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:39.059032 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6934a0dc-de8f-459c-bd39-ebd784e78062 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:39.060209 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6934a0dc-de8f-459c-bd39-ebd784e78062 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:39.388964 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6934a0dc-de8f-459c-bd39-ebd784e78062 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:39.398781 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6934a0dc-de8f-459c-bd39-ebd784e78062 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:39.403215 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6934a0dc-de8f-459c-bd39-ebd784e78062 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:39.404650 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-6934a0dc-de8f-459c-bd39-ebd784e78062 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1739 microversion: 2.20 time: 0.374249 Sep 23 15:26:39.414311 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 390/790] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:39 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1739 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:40.340411 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-92a4c6ba-cc6c-4e0c-81cd-528fe61b81e1 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:40.342105 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-92a4c6ba-cc6c-4e0c-81cd-528fe61b81e1 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:40.350239 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-92a4c6ba-cc6c-4e0c-81cd-528fe61b81e1 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:40.350819 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-92a4c6ba-cc6c-4e0c-81cd-528fe61b81e1 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:40.351331 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-92a4c6ba-cc6c-4e0c-81cd-528fe61b81e1 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:40.352140 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-92a4c6ba-cc6c-4e0c-81cd-528fe61b81e1 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:40.352663 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-92a4c6ba-cc6c-4e0c-81cd-528fe61b81e1 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:40.353216 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-92a4c6ba-cc6c-4e0c-81cd-528fe61b81e1 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:40.381908 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-92a4c6ba-cc6c-4e0c-81cd-528fe61b81e1 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c/ips" status: 200 len: 144 microversion: 2.1 time: 0.045364 Sep 23 15:26:40.382472 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 401/791] 10.222.0.55 () {58 vars in 1248 bytes} [Fri Sep 23 15:26:40 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c/ips => generated 144 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:40.444011 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-684acc67-26fd-4373-8c45-ee12f109f223 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:40.445302 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-684acc67-26fd-4373-8c45-ee12f109f223 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:40.467329 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-684acc67-26fd-4373-8c45-ee12f109f223 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:40.468621 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-684acc67-26fd-4373-8c45-ee12f109f223 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:40.471392 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-684acc67-26fd-4373-8c45-ee12f109f223 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:40.471392 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-684acc67-26fd-4373-8c45-ee12f109f223 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:40.471392 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-684acc67-26fd-4373-8c45-ee12f109f223 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:40.471392 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-684acc67-26fd-4373-8c45-ee12f109f223 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:40.703523 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-684acc67-26fd-4373-8c45-ee12f109f223 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:40.721416 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-684acc67-26fd-4373-8c45-ee12f109f223 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:40.723456 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-684acc67-26fd-4373-8c45-ee12f109f223 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:40.730171 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-684acc67-26fd-4373-8c45-ee12f109f223 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1739 microversion: 2.20 time: 0.290559 Sep 23 15:26:40.731444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 391/792] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:40 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1739 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:41.761788 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-ce6b2870-0f78-43b5-9b65-c3a4d4a5524d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:41.763075 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-ce6b2870-0f78-43b5-9b65-c3a4d4a5524d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:41.776455 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ce6b2870-0f78-43b5-9b65-c3a4d4a5524d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:41.776949 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ce6b2870-0f78-43b5-9b65-c3a4d4a5524d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:41.777382 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ce6b2870-0f78-43b5-9b65-c3a4d4a5524d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:41.778284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ce6b2870-0f78-43b5-9b65-c3a4d4a5524d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:41.778890 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ce6b2870-0f78-43b5-9b65-c3a4d4a5524d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:41.780295 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ce6b2870-0f78-43b5-9b65-c3a4d4a5524d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:41.957638 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-ce6b2870-0f78-43b5-9b65-c3a4d4a5524d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:41.967906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-ce6b2870-0f78-43b5-9b65-c3a4d4a5524d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:41.971474 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-ce6b2870-0f78-43b5-9b65-c3a4d4a5524d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:41.973507 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-ce6b2870-0f78-43b5-9b65-c3a4d4a5524d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1739 microversion: 2.20 time: 0.217738 Sep 23 15:26:41.998686 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 402/793] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:41 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1739 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:42.350749 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-158d5c35-ffae-4b4b-8b36-923c78e4992c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88387ba0-86da-4da0-82e6-e4a314ce1942"}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:42.353372 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-158d5c35-ffae-4b4b-8b36-923c78e4992c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:42.361423 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-158d5c35-ffae-4b4b-8b36-923c78e4992c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:42.362059 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-158d5c35-ffae-4b4b-8b36-923c78e4992c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:42.362751 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-158d5c35-ffae-4b4b-8b36-923c78e4992c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:42.364661 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-158d5c35-ffae-4b4b-8b36-923c78e4992c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:42.365411 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-158d5c35-ffae-4b4b-8b36-923c78e4992c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:42.366077 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-158d5c35-ffae-4b4b-8b36-923c78e4992c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:43.004071 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-f8ad99e6-1c86-4683-a9f3-948bef41c05a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:43.005317 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-f8ad99e6-1c86-4683-a9f3-948bef41c05a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:43.014299 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f8ad99e6-1c86-4683-a9f3-948bef41c05a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:43.018905 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f8ad99e6-1c86-4683-a9f3-948bef41c05a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:43.019681 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f8ad99e6-1c86-4683-a9f3-948bef41c05a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:43.022205 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f8ad99e6-1c86-4683-a9f3-948bef41c05a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:43.022999 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f8ad99e6-1c86-4683-a9f3-948bef41c05a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:43.024175 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f8ad99e6-1c86-4683-a9f3-948bef41c05a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:43.213242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-f8ad99e6-1c86-4683-a9f3-948bef41c05a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:43.224098 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-f8ad99e6-1c86-4683-a9f3-948bef41c05a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:43.225872 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-f8ad99e6-1c86-4683-a9f3-948bef41c05a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:43.227645 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-f8ad99e6-1c86-4683-a9f3-948bef41c05a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1739 microversion: 2.20 time: 0.227622 Sep 23 15:26:43.253685 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 403/794] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:42 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1739 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:26:43.787526 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-158d5c35-ffae-4b4b-8b36-923c78e4992c tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "POST /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.440765 Sep 23 15:26:43.794787 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 392/795] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Sep 23 15:26:42 2022] POST /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c/os-volume_attachments => generated 194 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:44.261271 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-778f5f82-143f-4596-87d7-cf896a5c2534 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:44.262114 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-778f5f82-143f-4596-87d7-cf896a5c2534 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:44.270152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-778f5f82-143f-4596-87d7-cf896a5c2534 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:44.270647 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-778f5f82-143f-4596-87d7-cf896a5c2534 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:44.271084 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-778f5f82-143f-4596-87d7-cf896a5c2534 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:44.271791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-778f5f82-143f-4596-87d7-cf896a5c2534 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:44.272272 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-778f5f82-143f-4596-87d7-cf896a5c2534 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:44.275526 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-778f5f82-143f-4596-87d7-cf896a5c2534 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:44.540987 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-778f5f82-143f-4596-87d7-cf896a5c2534 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:44.553837 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-778f5f82-143f-4596-87d7-cf896a5c2534 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:44.556310 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-778f5f82-143f-4596-87d7-cf896a5c2534 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:44.557872 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-778f5f82-143f-4596-87d7-cf896a5c2534 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1739 microversion: 2.20 time: 0.300555 Sep 23 15:26:44.559090 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 404/796] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:44 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1739 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:45.588696 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6bb17bbb-7af6-40f6-b5c6-6faff83bb121 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:45.589666 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-6bb17bbb-7af6-40f6-b5c6-6faff83bb121 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:45.603777 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6bb17bbb-7af6-40f6-b5c6-6faff83bb121 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:45.609428 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6bb17bbb-7af6-40f6-b5c6-6faff83bb121 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:45.610247 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6bb17bbb-7af6-40f6-b5c6-6faff83bb121 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:45.611681 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6bb17bbb-7af6-40f6-b5c6-6faff83bb121 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:45.612402 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6bb17bbb-7af6-40f6-b5c6-6faff83bb121 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:45.613028 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6bb17bbb-7af6-40f6-b5c6-6faff83bb121 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:45.832763 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6bb17bbb-7af6-40f6-b5c6-6faff83bb121 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:45.842317 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6bb17bbb-7af6-40f6-b5c6-6faff83bb121 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:45.844080 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6bb17bbb-7af6-40f6-b5c6-6faff83bb121 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:45.854042 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-6bb17bbb-7af6-40f6-b5c6-6faff83bb121 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1739 microversion: 2.20 time: 0.261552 Sep 23 15:26:45.854042 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 393/797] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:45 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1739 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:46.873197 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-10f3c973-c830-4480-a250-2309681b6608 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:46.873849 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-10f3c973-c830-4480-a250-2309681b6608 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:46.881175 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-10f3c973-c830-4480-a250-2309681b6608 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:46.881665 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-10f3c973-c830-4480-a250-2309681b6608 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:46.882109 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-10f3c973-c830-4480-a250-2309681b6608 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:46.885330 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-10f3c973-c830-4480-a250-2309681b6608 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:46.892580 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-10f3c973-c830-4480-a250-2309681b6608 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:46.895546 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-10f3c973-c830-4480-a250-2309681b6608 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:47.210327 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-10f3c973-c830-4480-a250-2309681b6608 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:47.221928 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-10f3c973-c830-4480-a250-2309681b6608 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:47.226402 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-10f3c973-c830-4480-a250-2309681b6608 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:47.228131 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-10f3c973-c830-4480-a250-2309681b6608 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1739 microversion: 2.20 time: 0.361231 Sep 23 15:26:47.228717 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 405/798] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:46 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1739 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:48.256965 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-75ee1c8c-9c13-40e0-a8c4-0550e8b6b23d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:48.257670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-75ee1c8c-9c13-40e0-a8c4-0550e8b6b23d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:48.260685 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_api:SELECT=42 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:48.269504 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-75ee1c8c-9c13-40e0-a8c4-0550e8b6b23d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:48.270008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-75ee1c8c-9c13-40e0-a8c4-0550e8b6b23d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:48.270497 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-75ee1c8c-9c13-40e0-a8c4-0550e8b6b23d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:48.271151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-75ee1c8c-9c13-40e0-a8c4-0550e8b6b23d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:48.271602 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-75ee1c8c-9c13-40e0-a8c4-0550e8b6b23d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:48.272114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-75ee1c8c-9c13-40e0-a8c4-0550e8b6b23d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:48.456947 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-75ee1c8c-9c13-40e0-a8c4-0550e8b6b23d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:48.467624 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-75ee1c8c-9c13-40e0-a8c4-0550e8b6b23d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:48.473631 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-75ee1c8c-9c13-40e0-a8c4-0550e8b6b23d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:48.474867 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-75ee1c8c-9c13-40e0-a8c4-0550e8b6b23d tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1721 microversion: 2.20 time: 0.224058 Sep 23 15:26:48.475507 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 394/799] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:48 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:49.505426 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-9597f300-c27a-4b5c-b08e-2760cb68f67c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:49.506564 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-9597f300-c27a-4b5c-b08e-2760cb68f67c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:49.513379 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9597f300-c27a-4b5c-b08e-2760cb68f67c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:49.514239 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9597f300-c27a-4b5c-b08e-2760cb68f67c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:49.514687 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9597f300-c27a-4b5c-b08e-2760cb68f67c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:49.515432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9597f300-c27a-4b5c-b08e-2760cb68f67c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:49.515892 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9597f300-c27a-4b5c-b08e-2760cb68f67c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:49.516349 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9597f300-c27a-4b5c-b08e-2760cb68f67c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:49.669810 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-9597f300-c27a-4b5c-b08e-2760cb68f67c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:49.683632 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-9597f300-c27a-4b5c-b08e-2760cb68f67c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:49.692216 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-9597f300-c27a-4b5c-b08e-2760cb68f67c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:49.692216 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-9597f300-c27a-4b5c-b08e-2760cb68f67c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1721 microversion: 2.20 time: 0.188764 Sep 23 15:26:49.705904 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 406/800] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:49 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:49.933449 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-c8397803-1600-43d5-8433-9bc1cb970f9b tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Action: 'create', calling method: .version_select at 0x7f82db9dc280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-40050967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfwDym7JUkVwDIQJHMCtqqNDwr2CteiRT0UaDZYdP4CEsvI+bzT6XKFJOOyixz/C2BsWtE13tomn5UCfiAQ0le1FOOd4SebMQbM3xSYD8KiEQyFcrcFbqfi/i9jsgwdsw=="}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:49.949709 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-c8397803-1600-43d5-8433-9bc1cb970f9b tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Getting quotas for project d86aa99c129b476980f17821cd30ef30. Resources: {'key_pairs'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:26:49.953581 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-c8397803-1600-43d5-8433-9bc1cb970f9b tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Getting quotas for user 1cb120cee6bf4ef4b7da15735f5f77e1 and project d86aa99c129b476980f17821cd30ef30. Resources: {'key_pairs'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:26:50.071472 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-c8397803-1600-43d5-8433-9bc1cb970f9b tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.313547 Sep 23 15:26:50.072137 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 395/801] 10.222.0.55 () {60 vars in 1159 bytes} [Fri Sep 23 15:26:49 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:50.717070 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-9948ce73-bff1-4a0f-b333-8d495861f0bd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:50.717904 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-9948ce73-bff1-4a0f-b333-8d495861f0bd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:50.724739 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9948ce73-bff1-4a0f-b333-8d495861f0bd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:50.725235 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9948ce73-bff1-4a0f-b333-8d495861f0bd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:50.725664 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9948ce73-bff1-4a0f-b333-8d495861f0bd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:50.726527 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9948ce73-bff1-4a0f-b333-8d495861f0bd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:50.726983 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9948ce73-bff1-4a0f-b333-8d495861f0bd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:50.727410 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9948ce73-bff1-4a0f-b333-8d495861f0bd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:50.879925 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-9948ce73-bff1-4a0f-b333-8d495861f0bd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:50.893471 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-9948ce73-bff1-4a0f-b333-8d495861f0bd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:50.893471 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-9948ce73-bff1-4a0f-b333-8d495861f0bd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:50.893471 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-9948ce73-bff1-4a0f-b333-8d495861f0bd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1721 microversion: 2.20 time: 0.181100 Sep 23 15:26:50.894146 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 407/802] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:50 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:51.936783 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-b91c5314-c564-4ce7-8845-af657e9af711 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:51.939112 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-b91c5314-c564-4ce7-8845-af657e9af711 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:51.969437 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b91c5314-c564-4ce7-8845-af657e9af711 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:51.970305 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b91c5314-c564-4ce7-8845-af657e9af711 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:51.971085 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b91c5314-c564-4ce7-8845-af657e9af711 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:51.972441 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b91c5314-c564-4ce7-8845-af657e9af711 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:51.973724 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b91c5314-c564-4ce7-8845-af657e9af711 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:51.974771 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b91c5314-c564-4ce7-8845-af657e9af711 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:52.198950 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b91c5314-c564-4ce7-8845-af657e9af711 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:52.205678 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b91c5314-c564-4ce7-8845-af657e9af711 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:52.207127 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b91c5314-c564-4ce7-8845-af657e9af711 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:52.208579 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-b91c5314-c564-4ce7-8845-af657e9af711 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1724 microversion: 2.20 time: 0.290253 Sep 23 15:26:52.209500 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 396/803] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:51 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1724 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:52.237435 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-27350925-b972-47de-b3bb-c3eb69038200 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2105037a-fc42-4e77-ae7e-c678de0c6746"}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:52.240595 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-27350925-b972-47de-b3bb-c3eb69038200 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:52.247661 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-27350925-b972-47de-b3bb-c3eb69038200 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:52.248289 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-27350925-b972-47de-b3bb-c3eb69038200 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:52.249105 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-27350925-b972-47de-b3bb-c3eb69038200 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:52.249810 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-27350925-b972-47de-b3bb-c3eb69038200 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:52.250259 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-27350925-b972-47de-b3bb-c3eb69038200 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:52.250859 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-27350925-b972-47de-b3bb-c3eb69038200 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:52.707242 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-311f2ed1-ce57-4269-ad2f-67db9fb86cdf req-cfc47535-f381-4c20-9930-61d20939ae82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46eb43e1-8a8e-4c5e-a071-ef900f024b55", "name": "network-vif-unplugged", "status": "completed", "tag": "372595b3-5ccc-49a2-81d3-b61302bfa68d"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:52.723046 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-311f2ed1-ce57-4269-ad2f-67db9fb86cdf req-cfc47535-f381-4c20-9930-61d20939ae82 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:52.723535 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-311f2ed1-ce57-4269-ad2f-67db9fb86cdf req-cfc47535-f381-4c20-9930-61d20939ae82 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:52.723971 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-311f2ed1-ce57-4269-ad2f-67db9fb86cdf req-cfc47535-f381-4c20-9930-61d20939ae82 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:52.742729 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.compute.server_external_events [req-311f2ed1-ce57-4269-ad2f-67db9fb86cdf req-cfc47535-f381-4c20-9930-61d20939ae82 service nova] Unable to find a host for instance 46eb43e1-8a8e-4c5e-a071-ef900f024b55. Dropping event network-vif-unplugged {{(pid=121448) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 23 15:26:52.744541 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-311f2ed1-ce57-4269-ad2f-67db9fb86cdf req-cfc47535-f381-4c20-9930-61d20939ae82 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.042371 Sep 23 15:26:52.745842 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 397/804] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 23 15:26:52.828025 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-9bf87fce-cba1-42a2-9477-e1ce9c97b76f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:52.830201 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-9bf87fce-cba1-42a2-9477-e1ce9c97b76f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:52.836436 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9bf87fce-cba1-42a2-9477-e1ce9c97b76f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:52.836928 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9bf87fce-cba1-42a2-9477-e1ce9c97b76f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:52.837399 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9bf87fce-cba1-42a2-9477-e1ce9c97b76f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:52.838106 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9bf87fce-cba1-42a2-9477-e1ce9c97b76f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:52.838565 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9bf87fce-cba1-42a2-9477-e1ce9c97b76f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:52.838992 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-9bf87fce-cba1-42a2-9477-e1ce9c97b76f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:52.878151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-9bf87fce-cba1-42a2-9477-e1ce9c97b76f tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055225 Sep 23 15:26:52.888236 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 398/805] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Sep 23 15:26:52 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:52.903696 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-883157a8-4f87-461f-aec1-650c47b36395 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:52.907525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-883157a8-4f87-461f-aec1-650c47b36395 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:52.918572 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-883157a8-4f87-461f-aec1-650c47b36395 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:52.919902 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-883157a8-4f87-461f-aec1-650c47b36395 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:52.920582 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-883157a8-4f87-461f-aec1-650c47b36395 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:52.922354 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-883157a8-4f87-461f-aec1-650c47b36395 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:52.924635 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-883157a8-4f87-461f-aec1-650c47b36395 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:52.925323 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-883157a8-4f87-461f-aec1-650c47b36395 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:52.970863 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-883157a8-4f87-461f-aec1-650c47b36395 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c/os-volume_attachments/88387ba0-86da-4da0-82e6-e4a314ce1942" status: 200 len: 194 microversion: 2.1 time: 0.071209 Sep 23 15:26:52.977346 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 399/806] 10.222.0.55 () {58 vars in 1413 bytes} [Fri Sep 23 15:26:52 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c/os-volume_attachments/88387ba0-86da-4da0-82e6-e4a314ce1942 => generated 194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:26:54.467422 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-27350925-b972-47de-b3bb-c3eb69038200 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "POST /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 2.236343 Sep 23 15:26:54.468080 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 408/807] 10.222.0.55 () {62 vars in 1364 bytes} [Fri Sep 23 15:26:52 2022] POST /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55/os-volume_attachments => generated 188 bytes in 2238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 15:26:54.829759 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-22e8ca3b-8e5d-432a-819e-05228f0424ee tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:54.830888 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-22e8ca3b-8e5d-432a-819e-05228f0424ee tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:54.838096 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-22e8ca3b-8e5d-432a-819e-05228f0424ee tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:54.838819 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-22e8ca3b-8e5d-432a-819e-05228f0424ee tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:54.839322 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-22e8ca3b-8e5d-432a-819e-05228f0424ee tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:54.840314 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-22e8ca3b-8e5d-432a-819e-05228f0424ee tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:54.840832 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-22e8ca3b-8e5d-432a-819e-05228f0424ee tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:54.842037 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-22e8ca3b-8e5d-432a-819e-05228f0424ee tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:55.407317 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-58197fc5-2e47-4f31-b0ea-89d442f245d9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2455019c-e97b-4f79-858c-c40bf80f53fe"}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:55.409944 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-58197fc5-2e47-4f31-b0ea-89d442f245d9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:55.417333 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-58197fc5-2e47-4f31-b0ea-89d442f245d9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:55.417818 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-58197fc5-2e47-4f31-b0ea-89d442f245d9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:55.418252 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-58197fc5-2e47-4f31-b0ea-89d442f245d9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:55.418976 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-58197fc5-2e47-4f31-b0ea-89d442f245d9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:55.419628 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-58197fc5-2e47-4f31-b0ea-89d442f245d9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:55.420173 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-58197fc5-2e47-4f31-b0ea-89d442f245d9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:55.670350 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:55.804743 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-22e8ca3b-8e5d-432a-819e-05228f0424ee tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "DELETE /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55/os-volume_attachments/2105037a-fc42-4e77-ae7e-c678de0c6746" status: 202 len: 0 microversion: 2.20 time: 0.979411 Sep 23 15:26:55.805388 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 400/808] 10.222.0.55 () {60 vars in 1457 bytes} [Fri Sep 23 15:26:54 2022] DELETE /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55/os-volume_attachments/2105037a-fc42-4e77-ae7e-c678de0c6746 => generated 0 bytes in 981 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 23 15:26:55.884086 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-65945c0b-fff6-4144-9467-b82be988f546 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:55.884824 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-65945c0b-fff6-4144-9467-b82be988f546 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:55.892644 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-65945c0b-fff6-4144-9467-b82be988f546 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:55.893136 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-65945c0b-fff6-4144-9467-b82be988f546 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:55.893579 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-65945c0b-fff6-4144-9467-b82be988f546 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:55.894301 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-65945c0b-fff6-4144-9467-b82be988f546 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:55.894767 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-65945c0b-fff6-4144-9467-b82be988f546 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:55.895196 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-65945c0b-fff6-4144-9467-b82be988f546 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:55.926935 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-65945c0b-fff6-4144-9467-b82be988f546 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121448) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 23 15:26:56.279778 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:56.317824 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-65945c0b-fff6-4144-9467-b82be988f546 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "POST /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55/action" status: 202 len: 0 microversion: 2.20 time: 0.437793 Sep 23 15:26:56.318499 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 401/809] 10.222.0.55 () {62 vars in 1319 bytes} [Fri Sep 23 15:26:55 2022] POST /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55/action => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 23 15:26:56.326840 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6ad7674c-91bd-4a86-b41e-678caf8f48a4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:56.327583 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-6ad7674c-91bd-4a86-b41e-678caf8f48a4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:56.333850 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6ad7674c-91bd-4a86-b41e-678caf8f48a4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:56.334406 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6ad7674c-91bd-4a86-b41e-678caf8f48a4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:56.334955 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6ad7674c-91bd-4a86-b41e-678caf8f48a4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:56.335813 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6ad7674c-91bd-4a86-b41e-678caf8f48a4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:56.336364 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6ad7674c-91bd-4a86-b41e-678caf8f48a4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:56.336857 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6ad7674c-91bd-4a86-b41e-678caf8f48a4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:56.493503 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6ad7674c-91bd-4a86-b41e-678caf8f48a4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:56.507784 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6ad7674c-91bd-4a86-b41e-678caf8f48a4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:56.509283 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6ad7674c-91bd-4a86-b41e-678caf8f48a4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:56.510473 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-6ad7674c-91bd-4a86-b41e-678caf8f48a4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1672 microversion: 2.20 time: 0.187560 Sep 23 15:26:56.519009 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 402/810] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:56 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1672 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:56.519154 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-58197fc5-2e47-4f31-b0ea-89d442f245d9 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "POST /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.112282 Sep 23 15:26:56.519154 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 409/811] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Sep 23 15:26:55 2022] POST /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c/os-volume_attachments => generated 194 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:26:57.544148 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-b8d88b4e-fc26-4ac6-9083-89e6e6c406f1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:57.544870 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-b8d88b4e-fc26-4ac6-9083-89e6e6c406f1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:57.551272 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b8d88b4e-fc26-4ac6-9083-89e6e6c406f1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:57.551758 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b8d88b4e-fc26-4ac6-9083-89e6e6c406f1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:57.552229 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b8d88b4e-fc26-4ac6-9083-89e6e6c406f1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:57.552979 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b8d88b4e-fc26-4ac6-9083-89e6e6c406f1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:57.553388 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b8d88b4e-fc26-4ac6-9083-89e6e6c406f1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:57.553816 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b8d88b4e-fc26-4ac6-9083-89e6e6c406f1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:57.705813 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b8d88b4e-fc26-4ac6-9083-89e6e6c406f1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:57.718153 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b8d88b4e-fc26-4ac6-9083-89e6e6c406f1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:57.721864 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b8d88b4e-fc26-4ac6-9083-89e6e6c406f1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:57.723757 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-b8d88b4e-fc26-4ac6-9083-89e6e6c406f1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1672 microversion: 2.20 time: 0.183711 Sep 23 15:26:57.724520 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 403/812] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:57 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1672 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:26:58.760284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-86252375-eb77-4220-a6aa-3d3c0541fdeb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:58.760284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-86252375-eb77-4220-a6aa-3d3c0541fdeb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:58.760284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-86252375-eb77-4220-a6aa-3d3c0541fdeb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:58.760284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-86252375-eb77-4220-a6aa-3d3c0541fdeb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:58.761520 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-86252375-eb77-4220-a6aa-3d3c0541fdeb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:58.761520 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-86252375-eb77-4220-a6aa-3d3c0541fdeb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:58.761703 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-86252375-eb77-4220-a6aa-3d3c0541fdeb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:58.762022 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-86252375-eb77-4220-a6aa-3d3c0541fdeb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:58.985985 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-86252375-eb77-4220-a6aa-3d3c0541fdeb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:58.994289 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-86252375-eb77-4220-a6aa-3d3c0541fdeb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:58.995734 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-86252375-eb77-4220-a6aa-3d3c0541fdeb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:58.997235 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-86252375-eb77-4220-a6aa-3d3c0541fdeb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1730 microversion: 2.20 time: 0.251026 Sep 23 15:26:58.998037 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 410/813] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:26:58 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1730 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:00.027695 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a3c4af78-251c-41ef-8083-be32609353fa tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:00.028790 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-a3c4af78-251c-41ef-8083-be32609353fa tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:00.031137 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell0:SELECT=4 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:00.036272 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a3c4af78-251c-41ef-8083-be32609353fa tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:00.036759 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a3c4af78-251c-41ef-8083-be32609353fa tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:00.037197 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a3c4af78-251c-41ef-8083-be32609353fa tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:00.037889 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a3c4af78-251c-41ef-8083-be32609353fa tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:00.038348 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a3c4af78-251c-41ef-8083-be32609353fa tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:00.038775 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a3c4af78-251c-41ef-8083-be32609353fa tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:00.229535 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a3c4af78-251c-41ef-8083-be32609353fa tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:00.240236 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a3c4af78-251c-41ef-8083-be32609353fa tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:00.242017 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a3c4af78-251c-41ef-8083-be32609353fa tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:00.243195 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-a3c4af78-251c-41ef-8083-be32609353fa tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1730 microversion: 2.20 time: 0.219485 Sep 23 15:27:00.244510 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 404/814] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:00 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1730 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:01.273954 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-e6a7be02-7ae3-45d1-8860-2abcd20d4544 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:01.274586 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-e6a7be02-7ae3-45d1-8860-2abcd20d4544 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:01.282111 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e6a7be02-7ae3-45d1-8860-2abcd20d4544 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:01.282598 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e6a7be02-7ae3-45d1-8860-2abcd20d4544 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:01.283040 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e6a7be02-7ae3-45d1-8860-2abcd20d4544 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:01.283822 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e6a7be02-7ae3-45d1-8860-2abcd20d4544 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:01.284314 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e6a7be02-7ae3-45d1-8860-2abcd20d4544 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:01.284742 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e6a7be02-7ae3-45d1-8860-2abcd20d4544 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:01.437543 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-e6a7be02-7ae3-45d1-8860-2abcd20d4544 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:01.446954 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-e6a7be02-7ae3-45d1-8860-2abcd20d4544 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:01.448959 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-e6a7be02-7ae3-45d1-8860-2abcd20d4544 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:01.450344 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-e6a7be02-7ae3-45d1-8860-2abcd20d4544 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1730 microversion: 2.20 time: 0.180287 Sep 23 15:27:01.451418 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 411/815] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:01 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:02.477174 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6b75acd8-8ee3-44b9-a5c8-068dc8b2448b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:02.477910 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-6b75acd8-8ee3-44b9-a5c8-068dc8b2448b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:02.487066 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6b75acd8-8ee3-44b9-a5c8-068dc8b2448b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:02.487577 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6b75acd8-8ee3-44b9-a5c8-068dc8b2448b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:02.488080 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6b75acd8-8ee3-44b9-a5c8-068dc8b2448b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:02.488800 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6b75acd8-8ee3-44b9-a5c8-068dc8b2448b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:02.489267 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6b75acd8-8ee3-44b9-a5c8-068dc8b2448b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:02.489767 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6b75acd8-8ee3-44b9-a5c8-068dc8b2448b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:02.669600 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6b75acd8-8ee3-44b9-a5c8-068dc8b2448b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:02.682221 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6b75acd8-8ee3-44b9-a5c8-068dc8b2448b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:02.683802 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6b75acd8-8ee3-44b9-a5c8-068dc8b2448b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:02.686742 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-6b75acd8-8ee3-44b9-a5c8-068dc8b2448b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1730 microversion: 2.20 time: 0.213434 Sep 23 15:27:02.697396 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 405/816] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:02 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1730 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:03.730601 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-462f8997-38e5-4062-84de-29e04085d548 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:03.742889 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-462f8997-38e5-4062-84de-29e04085d548 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:03.742889 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-462f8997-38e5-4062-84de-29e04085d548 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:03.744601 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-462f8997-38e5-4062-84de-29e04085d548 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:03.745443 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-462f8997-38e5-4062-84de-29e04085d548 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:03.746652 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-462f8997-38e5-4062-84de-29e04085d548 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:03.748527 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-462f8997-38e5-4062-84de-29e04085d548 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:03.749567 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-462f8997-38e5-4062-84de-29e04085d548 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:04.242210 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-462f8997-38e5-4062-84de-29e04085d548 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:04.260391 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-462f8997-38e5-4062-84de-29e04085d548 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:04.262075 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-462f8997-38e5-4062-84de-29e04085d548 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:04.264088 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-462f8997-38e5-4062-84de-29e04085d548 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1730 microversion: 2.20 time: 0.537477 Sep 23 15:27:04.265171 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 412/817] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:03 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1730 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:05.292563 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-0f5772fe-c824-4794-a0f4-28db297e3618 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:05.294850 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-0f5772fe-c824-4794-a0f4-28db297e3618 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:05.304591 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0f5772fe-c824-4794-a0f4-28db297e3618 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:05.304591 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0f5772fe-c824-4794-a0f4-28db297e3618 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:05.304591 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0f5772fe-c824-4794-a0f4-28db297e3618 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:05.305070 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0f5772fe-c824-4794-a0f4-28db297e3618 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:05.305154 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0f5772fe-c824-4794-a0f4-28db297e3618 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:05.305819 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0f5772fe-c824-4794-a0f4-28db297e3618 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:05.546805 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-0f5772fe-c824-4794-a0f4-28db297e3618 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:05.586389 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-0f5772fe-c824-4794-a0f4-28db297e3618 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:05.588317 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-0f5772fe-c824-4794-a0f4-28db297e3618 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:05.590406 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-0f5772fe-c824-4794-a0f4-28db297e3618 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1730 microversion: 2.20 time: 0.303877 Sep 23 15:27:05.594134 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 406/818] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:05 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1730 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:06.618454 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-bbe3e96b-6dd9-4d92-964e-87273a20fcad tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:06.619870 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-bbe3e96b-6dd9-4d92-964e-87273a20fcad tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:06.628566 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bbe3e96b-6dd9-4d92-964e-87273a20fcad tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:06.629511 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bbe3e96b-6dd9-4d92-964e-87273a20fcad tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:06.630202 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bbe3e96b-6dd9-4d92-964e-87273a20fcad tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:06.631305 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bbe3e96b-6dd9-4d92-964e-87273a20fcad tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:06.632566 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bbe3e96b-6dd9-4d92-964e-87273a20fcad tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:06.633217 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-bbe3e96b-6dd9-4d92-964e-87273a20fcad tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:06.812024 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-bbe3e96b-6dd9-4d92-964e-87273a20fcad tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:06.821264 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-bbe3e96b-6dd9-4d92-964e-87273a20fcad tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:06.822725 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-bbe3e96b-6dd9-4d92-964e-87273a20fcad tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:06.823903 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-bbe3e96b-6dd9-4d92-964e-87273a20fcad tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1730 microversion: 2.20 time: 0.210257 Sep 23 15:27:06.824728 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 413/819] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:06 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1730 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:07.850599 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-7e0c6546-ad73-4dd8-ad29-3394a8604234 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:07.851285 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-7e0c6546-ad73-4dd8-ad29-3394a8604234 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:07.859265 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7e0c6546-ad73-4dd8-ad29-3394a8604234 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:07.860404 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7e0c6546-ad73-4dd8-ad29-3394a8604234 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:07.861355 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7e0c6546-ad73-4dd8-ad29-3394a8604234 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:07.862715 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7e0c6546-ad73-4dd8-ad29-3394a8604234 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:07.863552 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7e0c6546-ad73-4dd8-ad29-3394a8604234 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:07.864632 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7e0c6546-ad73-4dd8-ad29-3394a8604234 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:08.045800 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-7e0c6546-ad73-4dd8-ad29-3394a8604234 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:08.054499 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-7e0c6546-ad73-4dd8-ad29-3394a8604234 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:08.056965 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-7e0c6546-ad73-4dd8-ad29-3394a8604234 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:08.058147 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-7e0c6546-ad73-4dd8-ad29-3394a8604234 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1730 microversion: 2.20 time: 0.211423 Sep 23 15:27:08.058716 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 407/820] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:07 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:09.085726 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-fd925894-8a39-4381-b488-e8e5bec1523b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:09.086338 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-fd925894-8a39-4381-b488-e8e5bec1523b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:09.092621 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fd925894-8a39-4381-b488-e8e5bec1523b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:09.093103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fd925894-8a39-4381-b488-e8e5bec1523b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:09.093544 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fd925894-8a39-4381-b488-e8e5bec1523b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:09.094236 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fd925894-8a39-4381-b488-e8e5bec1523b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:09.094758 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fd925894-8a39-4381-b488-e8e5bec1523b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:09.095185 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fd925894-8a39-4381-b488-e8e5bec1523b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:09.320626 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-fd925894-8a39-4381-b488-e8e5bec1523b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:09.330422 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-fd925894-8a39-4381-b488-e8e5bec1523b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:09.332259 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-fd925894-8a39-4381-b488-e8e5bec1523b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:09.333513 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-fd925894-8a39-4381-b488-e8e5bec1523b tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1730 microversion: 2.20 time: 0.251789 Sep 23 15:27:09.334254 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 414/821] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:09 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1730 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:10.358956 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-39d58cd3-e789-4853-9692-f8ddcff43994 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:10.359568 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-39d58cd3-e789-4853-9692-f8ddcff43994 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:10.367160 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-39d58cd3-e789-4853-9692-f8ddcff43994 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:10.367644 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-39d58cd3-e789-4853-9692-f8ddcff43994 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:10.368299 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-39d58cd3-e789-4853-9692-f8ddcff43994 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:10.369094 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-39d58cd3-e789-4853-9692-f8ddcff43994 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:10.369533 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-39d58cd3-e789-4853-9692-f8ddcff43994 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:10.369888 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-39d58cd3-e789-4853-9692-f8ddcff43994 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:10.516129 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-39d58cd3-e789-4853-9692-f8ddcff43994 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:10.525605 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-39d58cd3-e789-4853-9692-f8ddcff43994 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:10.540268 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-39d58cd3-e789-4853-9692-f8ddcff43994 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:10.540268 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-39d58cd3-e789-4853-9692-f8ddcff43994 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1730 microversion: 2.20 time: 0.173785 Sep 23 15:27:10.540268 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 408/822] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:10 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:11.554146 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-c73fd44b-a7d5-4c26-bf90-a06567f76582 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:11.554882 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-c73fd44b-a7d5-4c26-bf90-a06567f76582 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:11.561930 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c73fd44b-a7d5-4c26-bf90-a06567f76582 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:11.563450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c73fd44b-a7d5-4c26-bf90-a06567f76582 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:11.563450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c73fd44b-a7d5-4c26-bf90-a06567f76582 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:11.563678 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c73fd44b-a7d5-4c26-bf90-a06567f76582 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:11.564135 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c73fd44b-a7d5-4c26-bf90-a06567f76582 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:11.564577 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c73fd44b-a7d5-4c26-bf90-a06567f76582 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:11.744418 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-c73fd44b-a7d5-4c26-bf90-a06567f76582 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:11.759784 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-c73fd44b-a7d5-4c26-bf90-a06567f76582 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:11.761278 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-c73fd44b-a7d5-4c26-bf90-a06567f76582 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:11.764523 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-c73fd44b-a7d5-4c26-bf90-a06567f76582 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1730 microversion: 2.20 time: 0.212437 Sep 23 15:27:11.764523 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 415/823] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:11 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1730 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:11.822539 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-374de2b5-6672-4fb5-a82b-c78f7a2f5476 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:11.824970 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-374de2b5-6672-4fb5-a82b-c78f7a2f5476 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:11.833348 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-374de2b5-6672-4fb5-a82b-c78f7a2f5476 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:11.836302 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-374de2b5-6672-4fb5-a82b-c78f7a2f5476 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:11.836302 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-374de2b5-6672-4fb5-a82b-c78f7a2f5476 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:11.836302 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-374de2b5-6672-4fb5-a82b-c78f7a2f5476 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:11.836302 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-374de2b5-6672-4fb5-a82b-c78f7a2f5476 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:11.837001 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-374de2b5-6672-4fb5-a82b-c78f7a2f5476 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:11.869943 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-374de2b5-6672-4fb5-a82b-c78f7a2f5476 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052742 Sep 23 15:27:11.870803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 409/824] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Sep 23 15:27:11 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:27:11.881308 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-dc892f30-a3f3-4ac8-96d0-9d36b29ef6d9 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1796904602", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-40050967", "security_groups": [{"name": "tempest-secgroup-smoke-1508895721"}], "block_device_mapping_v2": [{"uuid": "902ee355-5a09-4fc0-8ed2-8f2ee1665340", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9072055c-d8f5-4479-88ef-7d0bad15cace"}]}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:27:12.007110 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.network.neutron [None req-dc892f30-a3f3-4ac8-96d0-9d36b29ef6d9 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] validate_networks() for [('9072055c-d8f5-4479-88ef-7d0bad15cace', None, None, None, None, None)] {{(pid=121450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:27:12.019444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-e96ad7b0-b761-4039-9957-5c2b2f1a98d4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:12.020415 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-e96ad7b0-b761-4039-9957-5c2b2f1a98d4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:12.026911 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e96ad7b0-b761-4039-9957-5c2b2f1a98d4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:12.027879 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e96ad7b0-b761-4039-9957-5c2b2f1a98d4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:12.028508 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e96ad7b0-b761-4039-9957-5c2b2f1a98d4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:12.030410 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e96ad7b0-b761-4039-9957-5c2b2f1a98d4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:12.031102 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e96ad7b0-b761-4039-9957-5c2b2f1a98d4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:12.031699 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e96ad7b0-b761-4039-9957-5c2b2f1a98d4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:12.070429 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-e96ad7b0-b761-4039-9957-5c2b2f1a98d4 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c/os-volume_attachments/88387ba0-86da-4da0-82e6-e4a314ce1942" status: 200 len: 194 microversion: 2.1 time: 0.050403 Sep 23 15:27:12.070429 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 410/825] 10.222.0.55 () {58 vars in 1413 bytes} [Fri Sep 23 15:27:12 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c/os-volume_attachments/88387ba0-86da-4da0-82e6-e4a314ce1942 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:27:12.078274 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-1e59db10-27cf-49d3-b39e-ae105d8ac3ca tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:12.078776 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-1e59db10-27cf-49d3-b39e-ae105d8ac3ca tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:12.084828 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1e59db10-27cf-49d3-b39e-ae105d8ac3ca tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:12.085555 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1e59db10-27cf-49d3-b39e-ae105d8ac3ca tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:12.085752 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1e59db10-27cf-49d3-b39e-ae105d8ac3ca tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:12.086459 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1e59db10-27cf-49d3-b39e-ae105d8ac3ca tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:12.086917 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1e59db10-27cf-49d3-b39e-ae105d8ac3ca tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:12.087346 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1e59db10-27cf-49d3-b39e-ae105d8ac3ca tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:12.172181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.objects.instance [None req-1e59db10-27cf-49d3-b39e-ae105d8ac3ca tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lazy-loading 'services' on Instance uuid 3f41b2c1-177e-47f5-b7d5-48166096714c {{(pid=121448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:27:12.217486 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_api:SELECT=34 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:12.441616 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-1e59db10-27cf-49d3-b39e-ae105d8ac3ca tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c/os-volume_attachments/88387ba0-86da-4da0-82e6-e4a314ce1942" status: 202 len: 0 microversion: 2.1 time: 0.367616 Sep 23 15:27:12.442219 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 411/826] 10.222.0.55 () {58 vars in 1416 bytes} [Fri Sep 23 15:27:12 2022] DELETE /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c/os-volume_attachments/88387ba0-86da-4da0-82e6-e4a314ce1942 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:27:12.519491 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-dc892f30-a3f3-4ac8-96d0-9d36b29ef6d9 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Flavor limits 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:27:12.519885 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-dc892f30-a3f3-4ac8-96d0-9d36b29ef6d9 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Image limits 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:27:12.520470 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-dc892f30-a3f3-4ac8-96d0-9d36b29ef6d9 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Flavor pref 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:27:12.520873 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-dc892f30-a3f3-4ac8-96d0-9d36b29ef6d9 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Image pref 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:27:12.521307 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-dc892f30-a3f3-4ac8-96d0-9d36b29ef6d9 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:27:12.530615 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-dc892f30-a3f3-4ac8-96d0-9d36b29ef6d9 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:12.531090 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-dc892f30-a3f3-4ac8-96d0-9d36b29ef6d9 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:12.531522 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-dc892f30-a3f3-4ac8-96d0-9d36b29ef6d9 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:12.532287 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-dc892f30-a3f3-4ac8-96d0-9d36b29ef6d9 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:12.532735 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-dc892f30-a3f3-4ac8-96d0-9d36b29ef6d9 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:12.533152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-dc892f30-a3f3-4ac8-96d0-9d36b29ef6d9 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:12.550379 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-dc892f30-a3f3-4ac8-96d0-9d36b29ef6d9 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Getting quotas for project d86aa99c129b476980f17821cd30ef30. Resources: {'ram', 'instances', 'cores'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:27:12.554295 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-dc892f30-a3f3-4ac8-96d0-9d36b29ef6d9 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Getting quotas for user 1cb120cee6bf4ef4b7da15735f5f77e1 and project d86aa99c129b476980f17821cd30ef30. Resources: {'ram', 'instances', 'cores'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:27:12.617323 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-dc892f30-a3f3-4ac8-96d0-9d36b29ef6d9 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Going to run 1 instances... {{(pid=121450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:27:12.619741 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-dc892f30-a3f3-4ac8-96d0-9d36b29ef6d9 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='902ee355-5a09-4fc0-8ed2-8f2ee1665340',volume_size=None,volume_type=None)] {{(pid=121450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:27:12.791598 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-d2b17ceb-cef4-4613-8ae6-c70dc6d37612 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:12.792373 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-d2b17ceb-cef4-4613-8ae6-c70dc6d37612 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:12.800032 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d2b17ceb-cef4-4613-8ae6-c70dc6d37612 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:12.800538 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d2b17ceb-cef4-4613-8ae6-c70dc6d37612 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:12.801020 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d2b17ceb-cef4-4613-8ae6-c70dc6d37612 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:12.801725 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d2b17ceb-cef4-4613-8ae6-c70dc6d37612 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:12.802173 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d2b17ceb-cef4-4613-8ae6-c70dc6d37612 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:12.802780 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-d2b17ceb-cef4-4613-8ae6-c70dc6d37612 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:13.032048 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-d2b17ceb-cef4-4613-8ae6-c70dc6d37612 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:13.032048 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-d2b17ceb-cef4-4613-8ae6-c70dc6d37612 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:13.032750 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-d2b17ceb-cef4-4613-8ae6-c70dc6d37612 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:13.032750 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-d2b17ceb-cef4-4613-8ae6-c70dc6d37612 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1730 microversion: 2.20 time: 0.237280 Sep 23 15:27:13.032750 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 412/827] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:12 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1730 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:27:14.056240 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-0024ac81-ae82-45d6-8792-52927e2270bc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:14.058218 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-0024ac81-ae82-45d6-8792-52927e2270bc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:14.065719 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0024ac81-ae82-45d6-8792-52927e2270bc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:14.066557 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0024ac81-ae82-45d6-8792-52927e2270bc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:14.067224 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0024ac81-ae82-45d6-8792-52927e2270bc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:14.068196 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0024ac81-ae82-45d6-8792-52927e2270bc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:14.068976 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0024ac81-ae82-45d6-8792-52927e2270bc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:14.069571 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0024ac81-ae82-45d6-8792-52927e2270bc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:14.083782 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-dc892f30-a3f3-4ac8-96d0-9d36b29ef6d9 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.206364 Sep 23 15:27:14.092257 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 416/828] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Sep 23 15:27:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 2216 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:27:14.099915 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-12c0fdf9-b7d5-41a4-9509-b255817f10ad tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:14.100785 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-12c0fdf9-b7d5-41a4-9509-b255817f10ad tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:14.211198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-12c0fdf9-b7d5-41a4-9509-b255817f10ad tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb120cee6bf4ef4b7da15735f5f77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86aa99c129b476980f17821cd30ef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:14.237249 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-12c0fdf9-b7d5-41a4-9509-b255817f10ad tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 200 len: 1093 microversion: 2.1 time: 0.142737 Sep 23 15:27:14.253789 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 417/829] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:14 2022] GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 1093 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:14.263125 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-0024ac81-ae82-45d6-8792-52927e2270bc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:14.272809 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-0024ac81-ae82-45d6-8792-52927e2270bc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:14.274407 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-0024ac81-ae82-45d6-8792-52927e2270bc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:14.275595 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-0024ac81-ae82-45d6-8792-52927e2270bc tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1730 microversion: 2.20 time: 0.223587 Sep 23 15:27:14.276666 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 413/830] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:14 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1730 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:27:14.910708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-8387b167-c421-4deb-b87b-162902494670 req-47c4d290-ee1c-4af5-a259-b26f18c75736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46eb43e1-8a8e-4c5e-a071-ef900f024b55", "name": "network-vif-plugged", "status": "completed", "tag": "372595b3-5ccc-49a2-81d3-b61302bfa68d"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:27:14.922464 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-8387b167-c421-4deb-b87b-162902494670 req-47c4d290-ee1c-4af5-a259-b26f18c75736 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:14.922938 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-8387b167-c421-4deb-b87b-162902494670 req-47c4d290-ee1c-4af5-a259-b26f18c75736 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:14.923365 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-8387b167-c421-4deb-b87b-162902494670 req-47c4d290-ee1c-4af5-a259-b26f18c75736 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:14.933848 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-8387b167-c421-4deb-b87b-162902494670 req-47c4d290-ee1c-4af5-a259-b26f18c75736 service nova] Creating event network-vif-plugged:372595b3-5ccc-49a2-81d3-b61302bfa68d for instance 46eb43e1-8a8e-4c5e-a071-ef900f024b55 on hv-cinder-85530 Sep 23 15:27:14.939522 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-8387b167-c421-4deb-b87b-162902494670 req-47c4d290-ee1c-4af5-a259-b26f18c75736 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032087 Sep 23 15:27:14.939628 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 418/831] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:27:15.005177 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-3fcf3a4b-4676-4185-8ad5-a417f8806031 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:15.005962 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-3fcf3a4b-4676-4185-8ad5-a417f8806031 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:15.011933 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3fcf3a4b-4676-4185-8ad5-a417f8806031 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:15.012451 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3fcf3a4b-4676-4185-8ad5-a417f8806031 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:15.012888 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3fcf3a4b-4676-4185-8ad5-a417f8806031 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:15.013722 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3fcf3a4b-4676-4185-8ad5-a417f8806031 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:15.014190 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3fcf3a4b-4676-4185-8ad5-a417f8806031 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:15.014735 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3fcf3a4b-4676-4185-8ad5-a417f8806031 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:15.047219 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-3fcf3a4b-4676-4185-8ad5-a417f8806031 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c/os-volume_attachments/2455019c-e97b-4f79-858c-c40bf80f53fe" status: 200 len: 194 microversion: 2.1 time: 0.046169 Sep 23 15:27:15.047833 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 414/832] 10.222.0.55 () {58 vars in 1413 bytes} [Fri Sep 23 15:27:14 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c/os-volume_attachments/2455019c-e97b-4f79-858c-c40bf80f53fe => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:27:15.059322 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-ed920649-b89e-419f-a6c5-6f6e26cd1a68 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:15.059899 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-ed920649-b89e-419f-a6c5-6f6e26cd1a68 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:15.066347 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ed920649-b89e-419f-a6c5-6f6e26cd1a68 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:15.066887 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ed920649-b89e-419f-a6c5-6f6e26cd1a68 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:15.067328 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ed920649-b89e-419f-a6c5-6f6e26cd1a68 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:15.068056 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ed920649-b89e-419f-a6c5-6f6e26cd1a68 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:15.068509 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ed920649-b89e-419f-a6c5-6f6e26cd1a68 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:15.068928 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ed920649-b89e-419f-a6c5-6f6e26cd1a68 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:15.152174 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.objects.instance [None req-ed920649-b89e-419f-a6c5-6f6e26cd1a68 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lazy-loading 'services' on Instance uuid 3f41b2c1-177e-47f5-b7d5-48166096714c {{(pid=121450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:27:15.261737 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-e585e26e-4280-4e66-97d5-73119e1d60e6 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:15.262347 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-e585e26e-4280-4e66-97d5-73119e1d60e6 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:15.327775 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-e585e26e-4280-4e66-97d5-73119e1d60e6 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb120cee6bf4ef4b7da15735f5f77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86aa99c129b476980f17821cd30ef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:15.336652 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-e585e26e-4280-4e66-97d5-73119e1d60e6 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 200 len: 1093 microversion: 2.1 time: 0.078674 Sep 23 15:27:15.337309 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 415/833] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:15 2022] GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 1093 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:27:15.354591 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-b5b6a06e-d98f-4390-a81a-f7f9f5f122ab tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:15.358600 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-b5b6a06e-d98f-4390-a81a-f7f9f5f122ab tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:15.366229 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b5b6a06e-d98f-4390-a81a-f7f9f5f122ab tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:15.367489 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b5b6a06e-d98f-4390-a81a-f7f9f5f122ab tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:15.368165 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b5b6a06e-d98f-4390-a81a-f7f9f5f122ab tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:15.368954 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b5b6a06e-d98f-4390-a81a-f7f9f5f122ab tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:15.369919 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b5b6a06e-d98f-4390-a81a-f7f9f5f122ab tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:15.370418 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b5b6a06e-d98f-4390-a81a-f7f9f5f122ab tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:15.386580 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:15.441029 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-ed920649-b89e-419f-a6c5-6f6e26cd1a68 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c/os-volume_attachments/2455019c-e97b-4f79-858c-c40bf80f53fe" status: 202 len: 0 microversion: 2.1 time: 0.385916 Sep 23 15:27:15.441660 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 419/834] 10.222.0.55 () {58 vars in 1416 bytes} [Fri Sep 23 15:27:15 2022] DELETE /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c/os-volume_attachments/2455019c-e97b-4f79-858c-c40bf80f53fe => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:27:15.521492 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b5b6a06e-d98f-4390-a81a-f7f9f5f122ab tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:15.529823 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b5b6a06e-d98f-4390-a81a-f7f9f5f122ab tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:15.531326 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b5b6a06e-d98f-4390-a81a-f7f9f5f122ab tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:15.532562 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-b5b6a06e-d98f-4390-a81a-f7f9f5f122ab tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1730 microversion: 2.20 time: 0.183239 Sep 23 15:27:15.533244 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 416/835] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:15 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:16.368491 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-4b34cc44-4590-406d-8c96-fc551a8d60c3 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:16.369042 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-4b34cc44-4590-406d-8c96-fc551a8d60c3 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:16.375686 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4b34cc44-4590-406d-8c96-fc551a8d60c3 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:16.376194 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4b34cc44-4590-406d-8c96-fc551a8d60c3 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:16.376634 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4b34cc44-4590-406d-8c96-fc551a8d60c3 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:16.377316 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4b34cc44-4590-406d-8c96-fc551a8d60c3 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:16.377763 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4b34cc44-4590-406d-8c96-fc551a8d60c3 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:16.378180 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4b34cc44-4590-406d-8c96-fc551a8d60c3 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:16.443921 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-4b34cc44-4590-406d-8c96-fc551a8d60c3 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb120cee6bf4ef4b7da15735f5f77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86aa99c129b476980f17821cd30ef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:16.451631 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-4b34cc44-4590-406d-8c96-fc551a8d60c3 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 200 len: 1143 microversion: 2.1 time: 0.088399 Sep 23 15:27:16.452237 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 420/836] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:16 2022] GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 1143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:16.570848 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-dfebe646-bc21-4be9-9525-ad3e57316b48 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:16.570848 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-dfebe646-bc21-4be9-9525-ad3e57316b48 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:16.570848 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dfebe646-bc21-4be9-9525-ad3e57316b48 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:16.570848 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dfebe646-bc21-4be9-9525-ad3e57316b48 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:16.571584 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dfebe646-bc21-4be9-9525-ad3e57316b48 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:16.571584 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dfebe646-bc21-4be9-9525-ad3e57316b48 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:16.571584 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dfebe646-bc21-4be9-9525-ad3e57316b48 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:16.571584 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dfebe646-bc21-4be9-9525-ad3e57316b48 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:16.712273 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-dfebe646-bc21-4be9-9525-ad3e57316b48 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:16.722008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-dfebe646-bc21-4be9-9525-ad3e57316b48 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:16.723495 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-dfebe646-bc21-4be9-9525-ad3e57316b48 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:16.724721 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-dfebe646-bc21-4be9-9525-ad3e57316b48 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1730 microversion: 2.20 time: 0.168569 Sep 23 15:27:16.725285 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 417/837] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:16 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:17.474123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-862b2a3c-032c-4d6e-a0f2-f947a88c6ceb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:17.474730 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-862b2a3c-032c-4d6e-a0f2-f947a88c6ceb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:17.481051 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-862b2a3c-032c-4d6e-a0f2-f947a88c6ceb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:17.481528 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-862b2a3c-032c-4d6e-a0f2-f947a88c6ceb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:17.481962 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-862b2a3c-032c-4d6e-a0f2-f947a88c6ceb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:17.482636 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-862b2a3c-032c-4d6e-a0f2-f947a88c6ceb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:17.483705 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-862b2a3c-032c-4d6e-a0f2-f947a88c6ceb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:17.484197 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-862b2a3c-032c-4d6e-a0f2-f947a88c6ceb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:17.546665 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-862b2a3c-032c-4d6e-a0f2-f947a88c6ceb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb120cee6bf4ef4b7da15735f5f77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86aa99c129b476980f17821cd30ef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:17.554610 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-862b2a3c-032c-4d6e-a0f2-f947a88c6ceb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 200 len: 1191 microversion: 2.1 time: 0.084286 Sep 23 15:27:17.555173 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 421/838] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:17 2022] GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 1191 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:17.696399 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-3248597e-eec1-4581-98d3-92e7e0eece15 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:17.698740 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-3248597e-eec1-4581-98d3-92e7e0eece15 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:17.706223 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3248597e-eec1-4581-98d3-92e7e0eece15 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:17.706725 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3248597e-eec1-4581-98d3-92e7e0eece15 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:17.707160 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3248597e-eec1-4581-98d3-92e7e0eece15 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:17.707864 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3248597e-eec1-4581-98d3-92e7e0eece15 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:17.708369 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3248597e-eec1-4581-98d3-92e7e0eece15 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:17.708805 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3248597e-eec1-4581-98d3-92e7e0eece15 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:17.740207 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-3248597e-eec1-4581-98d3-92e7e0eece15 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048288 Sep 23 15:27:17.740774 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 418/839] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Sep 23 15:27:17 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 15:27:17.750492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-efea7e7f-2b38-42ce-aa6c-a592c61d56e3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:17.751148 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-efea7e7f-2b38-42ce-aa6c-a592c61d56e3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:17.757923 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-efea7e7f-2b38-42ce-aa6c-a592c61d56e3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:17.758427 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-efea7e7f-2b38-42ce-aa6c-a592c61d56e3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:17.759080 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-efea7e7f-2b38-42ce-aa6c-a592c61d56e3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:17.759815 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-efea7e7f-2b38-42ce-aa6c-a592c61d56e3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:17.760362 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-efea7e7f-2b38-42ce-aa6c-a592c61d56e3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:17.760810 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-efea7e7f-2b38-42ce-aa6c-a592c61d56e3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:17.864325 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-df073eb3-bfdd-4c41-aa56-d80b82dc43ec tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:17.866548 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-df073eb3-bfdd-4c41-aa56-d80b82dc43ec tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:17.872867 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-df073eb3-bfdd-4c41-aa56-d80b82dc43ec tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:17.873356 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-df073eb3-bfdd-4c41-aa56-d80b82dc43ec tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:17.873831 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-df073eb3-bfdd-4c41-aa56-d80b82dc43ec tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:17.874680 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-df073eb3-bfdd-4c41-aa56-d80b82dc43ec tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:17.875138 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-df073eb3-bfdd-4c41-aa56-d80b82dc43ec tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:17.875565 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-df073eb3-bfdd-4c41-aa56-d80b82dc43ec tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:17.915902 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-df073eb3-bfdd-4c41-aa56-d80b82dc43ec tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055456 Sep 23 15:27:17.916357 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-efea7e7f-2b38-42ce-aa6c-a592c61d56e3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:17.916644 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 419/840] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Sep 23 15:27:17 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 15:27:17.928326 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-efea7e7f-2b38-42ce-aa6c-a592c61d56e3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:17.930971 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-efea7e7f-2b38-42ce-aa6c-a592c61d56e3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:17.932621 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-efea7e7f-2b38-42ce-aa6c-a592c61d56e3 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1730 microversion: 2.20 time: 0.186639 Sep 23 15:27:17.933530 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 422/841] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:17 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:17.985609 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-460a7fde-62f7-4717-93d7-a1c53c1d0956 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:17.986044 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-460a7fde-62f7-4717-93d7-a1c53c1d0956 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:17.992188 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-460a7fde-62f7-4717-93d7-a1c53c1d0956 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:17.992680 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-460a7fde-62f7-4717-93d7-a1c53c1d0956 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:17.993199 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-460a7fde-62f7-4717-93d7-a1c53c1d0956 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:17.993905 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-460a7fde-62f7-4717-93d7-a1c53c1d0956 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:17.994369 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-460a7fde-62f7-4717-93d7-a1c53c1d0956 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:17.994853 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-460a7fde-62f7-4717-93d7-a1c53c1d0956 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:18.029094 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-460a7fde-62f7-4717-93d7-a1c53c1d0956 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Going to try to terminate instance {{(pid=121448) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:27:18.549659 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-460a7fde-62f7-4717-93d7-a1c53c1d0956 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c" status: 204 len: 0 microversion: 2.1 time: 0.568354 Sep 23 15:27:18.550254 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 420/842] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Sep 23 15:27:17 2022] DELETE /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c => generated 0 bytes in 570 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:27:18.558823 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-5ec887d3-ed6d-4725-8b6f-24d351784298 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:18.559400 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-5ec887d3-ed6d-4725-8b6f-24d351784298 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:18.567013 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5ec887d3-ed6d-4725-8b6f-24d351784298 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:18.567510 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5ec887d3-ed6d-4725-8b6f-24d351784298 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:18.568008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5ec887d3-ed6d-4725-8b6f-24d351784298 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:18.568784 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5ec887d3-ed6d-4725-8b6f-24d351784298 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:18.569243 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5ec887d3-ed6d-4725-8b6f-24d351784298 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:18.569672 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5ec887d3-ed6d-4725-8b6f-24d351784298 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:18.580368 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-0ed0abf7-5ce8-4104-804f-897a6fc02d2c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:18.581172 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-0ed0abf7-5ce8-4104-804f-897a6fc02d2c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:18.587762 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0ed0abf7-5ce8-4104-804f-897a6fc02d2c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:18.588506 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0ed0abf7-5ce8-4104-804f-897a6fc02d2c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:18.588956 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0ed0abf7-5ce8-4104-804f-897a6fc02d2c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:18.589665 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0ed0abf7-5ce8-4104-804f-897a6fc02d2c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:18.590118 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0ed0abf7-5ce8-4104-804f-897a6fc02d2c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:18.590732 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0ed0abf7-5ce8-4104-804f-897a6fc02d2c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:18.682948 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-0ed0abf7-5ce8-4104-804f-897a6fc02d2c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb120cee6bf4ef4b7da15735f5f77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86aa99c129b476980f17821cd30ef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:18.692077 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-0ed0abf7-5ce8-4104-804f-897a6fc02d2c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 200 len: 1199 microversion: 2.1 time: 0.116603 Sep 23 15:27:18.692898 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 421/843] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:18 2022] GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 1199 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:27:18.744754 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-5ec887d3-ed6d-4725-8b6f-24d351784298 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:18.753226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-5ec887d3-ed6d-4725-8b6f-24d351784298 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c" status: 200 len: 1671 microversion: 2.1 time: 0.198533 Sep 23 15:27:18.753805 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 423/844] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:18 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c => generated 1671 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:27:18.960263 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-266b79d1-c6a5-4300-aac5-17d56470d9d4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:18.960900 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-266b79d1-c6a5-4300-aac5-17d56470d9d4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:18.967144 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-266b79d1-c6a5-4300-aac5-17d56470d9d4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:18.968276 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-266b79d1-c6a5-4300-aac5-17d56470d9d4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:18.968648 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-266b79d1-c6a5-4300-aac5-17d56470d9d4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:18.969398 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-266b79d1-c6a5-4300-aac5-17d56470d9d4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:18.969848 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-266b79d1-c6a5-4300-aac5-17d56470d9d4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:18.970268 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-266b79d1-c6a5-4300-aac5-17d56470d9d4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:19.116560 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-266b79d1-c6a5-4300-aac5-17d56470d9d4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:19.126505 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-266b79d1-c6a5-4300-aac5-17d56470d9d4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:19.128020 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-266b79d1-c6a5-4300-aac5-17d56470d9d4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:19.129335 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-266b79d1-c6a5-4300-aac5-17d56470d9d4 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1730 microversion: 2.20 time: 0.172972 Sep 23 15:27:19.129903 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 422/845] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:18 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:19.719382 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-57143e19-304d-48f3-a666-178e5b5b089c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:19.720027 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-57143e19-304d-48f3-a666-178e5b5b089c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:19.726659 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-57143e19-304d-48f3-a666-178e5b5b089c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:19.727197 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-57143e19-304d-48f3-a666-178e5b5b089c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:19.727637 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-57143e19-304d-48f3-a666-178e5b5b089c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:19.728440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-57143e19-304d-48f3-a666-178e5b5b089c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:19.728900 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-57143e19-304d-48f3-a666-178e5b5b089c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:19.729325 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-57143e19-304d-48f3-a666-178e5b5b089c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:19.776803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-836e21bc-07d9-4b28-bc03-13dc775e1912 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:19.777514 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-836e21bc-07d9-4b28-bc03-13dc775e1912 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:19.779564 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:19.784442 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-836e21bc-07d9-4b28-bc03-13dc775e1912 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:19.785020 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-836e21bc-07d9-4b28-bc03-13dc775e1912 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:19.785521 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-836e21bc-07d9-4b28-bc03-13dc775e1912 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:19.786320 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-836e21bc-07d9-4b28-bc03-13dc775e1912 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:19.786774 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-836e21bc-07d9-4b28-bc03-13dc775e1912 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:19.787196 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-836e21bc-07d9-4b28-bc03-13dc775e1912 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:19.869536 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-57143e19-304d-48f3-a666-178e5b5b089c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb120cee6bf4ef4b7da15735f5f77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86aa99c129b476980f17821cd30ef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:19.878639 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-57143e19-304d-48f3-a666-178e5b5b089c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 200 len: 1277 microversion: 2.1 time: 0.163761 Sep 23 15:27:19.879221 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 424/846] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:19 2022] GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:19.934075 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-836e21bc-07d9-4b28-bc03-13dc775e1912 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:19.942444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-836e21bc-07d9-4b28-bc03-13dc775e1912 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c" status: 200 len: 1671 microversion: 2.1 time: 0.169635 Sep 23 15:27:19.943017 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 423/847] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:19 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c => generated 1671 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:27:20.158907 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-90072e97-887e-48ed-ba17-a4f909f85cdb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:20.162887 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-90072e97-887e-48ed-ba17-a4f909f85cdb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:20.176928 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-90072e97-887e-48ed-ba17-a4f909f85cdb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:20.177384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-90072e97-887e-48ed-ba17-a4f909f85cdb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:20.177813 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-90072e97-887e-48ed-ba17-a4f909f85cdb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:20.187607 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-90072e97-887e-48ed-ba17-a4f909f85cdb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:20.188041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-90072e97-887e-48ed-ba17-a4f909f85cdb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:20.188476 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-90072e97-887e-48ed-ba17-a4f909f85cdb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:20.501898 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-90072e97-887e-48ed-ba17-a4f909f85cdb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:20.510707 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-90072e97-887e-48ed-ba17-a4f909f85cdb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:20.512857 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-90072e97-887e-48ed-ba17-a4f909f85cdb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:20.513481 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-90072e97-887e-48ed-ba17-a4f909f85cdb tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1730 microversion: 2.20 time: 0.361427 Sep 23 15:27:20.514565 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 425/848] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:20 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1730 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:20.905749 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-563dc7b8-159b-4fb2-972a-7cc40733789f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:20.906468 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-563dc7b8-159b-4fb2-972a-7cc40733789f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:20.914072 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-563dc7b8-159b-4fb2-972a-7cc40733789f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:20.914613 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-563dc7b8-159b-4fb2-972a-7cc40733789f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:20.915059 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-563dc7b8-159b-4fb2-972a-7cc40733789f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:20.915760 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-563dc7b8-159b-4fb2-972a-7cc40733789f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:20.916244 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-563dc7b8-159b-4fb2-972a-7cc40733789f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:20.916673 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-563dc7b8-159b-4fb2-972a-7cc40733789f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:20.968794 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-0428120b-fd0b-4e1a-961f-b4090a9c8665 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:20.969446 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-0428120b-fd0b-4e1a-961f-b4090a9c8665 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:20.975990 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0428120b-fd0b-4e1a-961f-b4090a9c8665 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:20.976504 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0428120b-fd0b-4e1a-961f-b4090a9c8665 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:20.976946 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0428120b-fd0b-4e1a-961f-b4090a9c8665 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:20.977651 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0428120b-fd0b-4e1a-961f-b4090a9c8665 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:20.978110 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0428120b-fd0b-4e1a-961f-b4090a9c8665 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:20.978542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0428120b-fd0b-4e1a-961f-b4090a9c8665 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:21.080817 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-563dc7b8-159b-4fb2-972a-7cc40733789f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb120cee6bf4ef4b7da15735f5f77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86aa99c129b476980f17821cd30ef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:21.089927 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-563dc7b8-159b-4fb2-972a-7cc40733789f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 200 len: 1277 microversion: 2.1 time: 0.189047 Sep 23 15:27:21.090602 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 424/849] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:20 2022] GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 1277 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:27:21.246896 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-0428120b-fd0b-4e1a-961f-b4090a9c8665 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:21.255759 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-0428120b-fd0b-4e1a-961f-b4090a9c8665 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c" status: 200 len: 1671 microversion: 2.1 time: 0.293941 Sep 23 15:27:21.256384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 426/850] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:20 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c => generated 1671 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:27:21.541239 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-123fcde0-c4ff-4cb7-8746-36956b16304a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:21.542179 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-123fcde0-c4ff-4cb7-8746-36956b16304a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:21.542450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-4ff189ca-e76c-4cc7-9fcc-d58a685f10bd req-376dcd4f-2160-4d5c-9207-307591420d7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ce91179-3e48-4016-881a-72a63aa9daf1", "tag": "c2205af8-7e2a-495b-8ea9-4dccb9d37b61"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:27:21.555108 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-123fcde0-c4ff-4cb7-8746-36956b16304a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:21.556345 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-123fcde0-c4ff-4cb7-8746-36956b16304a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:21.556913 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-123fcde0-c4ff-4cb7-8746-36956b16304a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:21.558282 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-123fcde0-c4ff-4cb7-8746-36956b16304a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:21.559384 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-123fcde0-c4ff-4cb7-8746-36956b16304a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:21.559384 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-123fcde0-c4ff-4cb7-8746-36956b16304a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:21.561297 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-4ff189ca-e76c-4cc7-9fcc-d58a685f10bd req-376dcd4f-2160-4d5c-9207-307591420d7e service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:21.562144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-4ff189ca-e76c-4cc7-9fcc-d58a685f10bd req-376dcd4f-2160-4d5c-9207-307591420d7e service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:21.562833 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-4ff189ca-e76c-4cc7-9fcc-d58a685f10bd req-376dcd4f-2160-4d5c-9207-307591420d7e service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:21.583540 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-4ff189ca-e76c-4cc7-9fcc-d58a685f10bd req-376dcd4f-2160-4d5c-9207-307591420d7e service nova] Creating event network-changed:c2205af8-7e2a-495b-8ea9-4dccb9d37b61 for instance 8ce91179-3e48-4016-881a-72a63aa9daf1 on hv-cinder-85530 Sep 23 15:27:21.593592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-4ff189ca-e76c-4cc7-9fcc-d58a685f10bd req-376dcd4f-2160-4d5c-9207-307591420d7e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056062 Sep 23 15:27:21.594629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 427/851] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:27:21.744325 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-123fcde0-c4ff-4cb7-8746-36956b16304a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:21.753803 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-123fcde0-c4ff-4cb7-8746-36956b16304a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:21.755877 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-123fcde0-c4ff-4cb7-8746-36956b16304a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:21.757100 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-123fcde0-c4ff-4cb7-8746-36956b16304a tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1717 microversion: 2.20 time: 0.220974 Sep 23 15:27:21.768773 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 425/852] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:21 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1717 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:22.114862 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-17709e79-4445-451a-b166-dfd861d2992b tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:22.116504 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-17709e79-4445-451a-b166-dfd861d2992b tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:22.125128 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-17709e79-4445-451a-b166-dfd861d2992b tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:22.126123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-17709e79-4445-451a-b166-dfd861d2992b tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:22.126808 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-17709e79-4445-451a-b166-dfd861d2992b tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:22.127790 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-17709e79-4445-451a-b166-dfd861d2992b tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:22.128491 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-17709e79-4445-451a-b166-dfd861d2992b tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:22.129136 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-17709e79-4445-451a-b166-dfd861d2992b tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:22.135886 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=97,nova_cell1:INSERT=2 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:22.280777 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-0ba01353-af94-4973-b057-1633702db2c7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:22.287273 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-0ba01353-af94-4973-b057-1633702db2c7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:22.288748 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0ba01353-af94-4973-b057-1633702db2c7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:22.289367 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0ba01353-af94-4973-b057-1633702db2c7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:22.289812 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0ba01353-af94-4973-b057-1633702db2c7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:22.290520 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0ba01353-af94-4973-b057-1633702db2c7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:22.290978 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0ba01353-af94-4973-b057-1633702db2c7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:22.291609 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0ba01353-af94-4973-b057-1633702db2c7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:22.364890 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-0ba01353-af94-4973-b057-1633702db2c7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:22.374801 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-0ba01353-af94-4973-b057-1633702db2c7 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c" status: 200 len: 1322 microversion: 2.1 time: 0.097805 Sep 23 15:27:22.376016 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 426/853] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:22 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c => generated 1322 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:27:22.428024 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-17709e79-4445-451a-b166-dfd861d2992b tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb120cee6bf4ef4b7da15735f5f77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86aa99c129b476980f17821cd30ef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:22.436332 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-17709e79-4445-451a-b166-dfd861d2992b tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 200 len: 1265 microversion: 2.1 time: 0.326689 Sep 23 15:27:22.437235 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 428/854] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:22 2022] GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 1265 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:27:23.398641 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-b4840695-578f-4995-b296-5ce42eb06456 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:23.399159 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-b4840695-578f-4995-b296-5ce42eb06456 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:23.405673 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b4840695-578f-4995-b296-5ce42eb06456 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:23.406162 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b4840695-578f-4995-b296-5ce42eb06456 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:23.406611 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b4840695-578f-4995-b296-5ce42eb06456 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:23.407309 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b4840695-578f-4995-b296-5ce42eb06456 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:23.407770 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b4840695-578f-4995-b296-5ce42eb06456 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:23.408237 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b4840695-578f-4995-b296-5ce42eb06456 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:23.440214 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b4840695-578f-4995-b296-5ce42eb06456 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:23.440699 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b4840695-578f-4995-b296-5ce42eb06456 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:23.441140 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b4840695-578f-4995-b296-5ce42eb06456 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:23.441593 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.objects.instance [None req-b4840695-578f-4995-b296-5ce42eb06456 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lazy-loading 'fault' on Instance uuid 3f41b2c1-177e-47f5-b7d5-48166096714c {{(pid=121448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:27:23.460306 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-f968893a-1327-4692-85d3-908b86035de5 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:23.460922 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-f968893a-1327-4692-85d3-908b86035de5 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:23.463049 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell0:SELECT=2 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:23.469222 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f968893a-1327-4692-85d3-908b86035de5 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:23.469715 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f968893a-1327-4692-85d3-908b86035de5 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:23.470153 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f968893a-1327-4692-85d3-908b86035de5 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:23.470861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f968893a-1327-4692-85d3-908b86035de5 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:23.471320 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f968893a-1327-4692-85d3-908b86035de5 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:23.471745 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f968893a-1327-4692-85d3-908b86035de5 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:23.486464 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b4840695-578f-4995-b296-5ce42eb06456 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f0ecaf38e74c96bc439fde75d93d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab19e9f7cb0e49548a9ab74b9d2b4aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:23.494542 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-b4840695-578f-4995-b296-5ce42eb06456 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c" status: 200 len: 1327 microversion: 2.1 time: 0.099822 Sep 23 15:27:23.496053 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 427/855] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:23 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c => generated 1327 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:23.613606 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-6b35661f-6f8f-4467-918b-8a2e986cc483 req-f4f52a18-23cf-499b-b03f-91ca982238b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f41b2c1-177e-47f5-b7d5-48166096714c", "name": "network-vif-deleted", "tag": "55436e11-cb4f-4c3c-ab14-4385e7710520"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:27:23.615342 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-f968893a-1327-4692-85d3-908b86035de5 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb120cee6bf4ef4b7da15735f5f77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86aa99c129b476980f17821cd30ef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:23.624701 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-6b35661f-6f8f-4467-918b-8a2e986cc483 req-f4f52a18-23cf-499b-b03f-91ca982238b6 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:23.625187 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-6b35661f-6f8f-4467-918b-8a2e986cc483 req-f4f52a18-23cf-499b-b03f-91ca982238b6 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:23.625341 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-f968893a-1327-4692-85d3-908b86035de5 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 200 len: 1265 microversion: 2.1 time: 0.168708 Sep 23 15:27:23.625826 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-6b35661f-6f8f-4467-918b-8a2e986cc483 req-f4f52a18-23cf-499b-b03f-91ca982238b6 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:23.626519 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 429/856] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:23 2022] GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:27:23.637750 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-6b35661f-6f8f-4467-918b-8a2e986cc483 req-f4f52a18-23cf-499b-b03f-91ca982238b6 service nova] Creating event network-vif-deleted:55436e11-cb4f-4c3c-ab14-4385e7710520 for instance 3f41b2c1-177e-47f5-b7d5-48166096714c on hv-cinder-85530 Sep 23 15:27:23.643785 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-6b35661f-6f8f-4467-918b-8a2e986cc483 req-f4f52a18-23cf-499b-b03f-91ca982238b6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033944 Sep 23 15:27:23.644426 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 428/857] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:27:24.520751 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-9602b096-93d2-4dd5-a34b-c164321cdedc tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:24.521430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-9602b096-93d2-4dd5-a34b-c164321cdedc tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:24.523159 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell0:SELECT=8 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:24.529098 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9602b096-93d2-4dd5-a34b-c164321cdedc tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:24.530377 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9602b096-93d2-4dd5-a34b-c164321cdedc tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:24.530377 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9602b096-93d2-4dd5-a34b-c164321cdedc tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:24.534937 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9602b096-93d2-4dd5-a34b-c164321cdedc tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:24.534937 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9602b096-93d2-4dd5-a34b-c164321cdedc tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:24.534937 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9602b096-93d2-4dd5-a34b-c164321cdedc tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:24.545374 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-9602b096-93d2-4dd5-a34b-c164321cdedc tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] HTTP exception thrown: Instance 3f41b2c1-177e-47f5-b7d5-48166096714c could not be found. Sep 23 15:27:24.547094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-9602b096-93d2-4dd5-a34b-c164321cdedc tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Request method failure captured: Sep 23 15:27:24.547094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c HTTP/1.1 Sep 23 15:27:24.547094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:27:24.547094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:27:24.547094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:27:24.547094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:27:24.547094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:27:24.547094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:27:24.547094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:27:24.547094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:27:24.547094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLc6pTJg1az4Ztuh3qoUewU2vUIYF2UNMVycjpGT92b5ptyf0bTzHt6IOxB68C19pjhprHNzQyPKZFOrJndeA8-qkVlagw5impOAkU-3NZNReUk5d3hfw0bnXnOe0zvPho_U3zxHsi2bLIkww6dgmrCSYkKMrcHNoBDM3NRpWyNJzlgk Sep 23 15:27:24.547094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:27:24.547094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:27:24.547094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:27:24.547094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:27:24.547094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:27:24.547094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:27:24.547094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: ab19e9f7cb0e49548a9ab74b9d2b4aec Sep 23 15:27:24.547094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-AttachVolumeTestJSON-1011211645 Sep 23 15:27:24.547094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:27:24.547094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:27:24.548674 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ab19e9f7cb0e49548a9ab74b9d2b4aec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ab19e9f7cb0e49548a9ab74b9d2b4aec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ab19e9f7cb0e49548a9ab74b9d2b4aec", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ab19e9f7cb0e49548a9ab74b9d2b4aec"}]}] Sep 23 15:27:24.548674 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-AttachVolumeTestJSON-1011211645 Sep 23 15:27:24.548674 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: ab19e9f7cb0e49548a9ab74b9d2b4aec Sep 23 15:27:24.548674 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1011211645 Sep 23 15:27:24.548674 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-AttachVolumeTestJSON-1011211645-project Sep 23 15:27:24.548674 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:27:24.548674 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:27:24.548674 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: f5f0ecaf38e74c96bc439fde75d93d37 Sep 23 15:27:24.548674 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-AttachVolumeTestJSON-1011211645-project Sep 23 15:27:24.548674 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:27:24.548674 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance 3f41b2c1-177e-47f5-b7d5-48166096714c could not be found. Sep 23 15:27:24.548674 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '3f41b2c1-177e-47f5-b7d5-48166096714c'} Sep 23 15:27:24.549550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:27:24.549550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:27:24.549550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:27:24.549550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:27:24.549550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:27:24.549550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:27:24.549550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:27:24.549550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:27:24.549550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:27:24.549550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:27:24.549550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f41b2c1-177e-47f5-b7d5-48166096714c could not be found. Sep 23 15:27:24.549550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:27:24.549550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:27:24.549550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:27:24.549550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:27:24.549550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:27:24.549550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:27:24.549550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:27:24.549550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:27:24.549550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:27:24.551198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:27:24.551198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:27:24.551198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:27:24.551198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:27:24.551198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:27:24.551198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:27:24.551198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:27:24.551198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f41b2c1-177e-47f5-b7d5-48166096714c could not be found. Sep 23 15:27:24.551198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:27:24.551198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:27:24.551198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:27:24.551198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:27:24.551198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:27:24.551198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:27:24.551198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:27:24.551198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:27:24.551198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f41b2c1-177e-47f5-b7d5-48166096714c could not be found. Sep 23 15:27:24.551198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:27:24.552858 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-9602b096-93d2-4dd5-a34b-c164321cdedc tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Returning 404 to user: Instance 3f41b2c1-177e-47f5-b7d5-48166096714c could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:27:24.552858 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-9602b096-93d2-4dd5-a34b-c164321cdedc tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c" status: 404 len: 111 microversion: 2.1 time: 0.032563 Sep 23 15:27:24.552858 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 430/858] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:24 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:27:24.558500 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-8187cbf5-1294-4e31-b833-3d5b3226760b tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '.version_select at 0x7f82db9b83a0>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:24.648671 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-2e236135-e001-4123-94f9-4d618f78d015 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:24.649276 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-2e236135-e001-4123-94f9-4d618f78d015 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:24.655340 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2e236135-e001-4123-94f9-4d618f78d015 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:24.655796 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2e236135-e001-4123-94f9-4d618f78d015 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:24.656259 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2e236135-e001-4123-94f9-4d618f78d015 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:24.656944 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2e236135-e001-4123-94f9-4d618f78d015 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:24.657391 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2e236135-e001-4123-94f9-4d618f78d015 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:24.657806 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2e236135-e001-4123-94f9-4d618f78d015 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:24.704395 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-8187cbf5-1294-4e31-b833-3d5b3226760b tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-631336205" status: 202 len: 0 microversion: 2.1 time: 0.150416 Sep 23 15:27:24.710678 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 429/859] 10.222.0.55 () {58 vars in 1218 bytes} [Fri Sep 23 15:27:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-631336205 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:27:24.794110 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-2e236135-e001-4123-94f9-4d618f78d015 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb120cee6bf4ef4b7da15735f5f77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86aa99c129b476980f17821cd30ef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:24.802261 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-2e236135-e001-4123-94f9-4d618f78d015 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 200 len: 1265 microversion: 2.1 time: 0.157442 Sep 23 15:27:24.816008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 431/860] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:24 2022] GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:27:25.823723 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell0:SELECT=2 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:25.828715 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6a55dcc1-347c-4cb6-b4f2-c56f5fa3aa94 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:25.829410 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-6a55dcc1-347c-4cb6-b4f2-c56f5fa3aa94 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:25.835886 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6a55dcc1-347c-4cb6-b4f2-c56f5fa3aa94 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:25.836400 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6a55dcc1-347c-4cb6-b4f2-c56f5fa3aa94 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:25.836831 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6a55dcc1-347c-4cb6-b4f2-c56f5fa3aa94 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:25.837512 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6a55dcc1-347c-4cb6-b4f2-c56f5fa3aa94 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:25.837962 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6a55dcc1-347c-4cb6-b4f2-c56f5fa3aa94 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:25.838381 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6a55dcc1-347c-4cb6-b4f2-c56f5fa3aa94 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:25.970025 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6a55dcc1-347c-4cb6-b4f2-c56f5fa3aa94 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb120cee6bf4ef4b7da15735f5f77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86aa99c129b476980f17821cd30ef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:25.977758 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-6a55dcc1-347c-4cb6-b4f2-c56f5fa3aa94 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 200 len: 1265 microversion: 2.1 time: 0.154888 Sep 23 15:27:25.978330 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 430/861] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:25 2022] GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:27.003232 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-289dee10-802e-4477-9338-7f71aaea87cb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:27.003232 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-289dee10-802e-4477-9338-7f71aaea87cb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:27.008739 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-289dee10-802e-4477-9338-7f71aaea87cb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:27.009386 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-289dee10-802e-4477-9338-7f71aaea87cb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:27.009706 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-289dee10-802e-4477-9338-7f71aaea87cb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:27.010408 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-289dee10-802e-4477-9338-7f71aaea87cb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:27.010864 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-289dee10-802e-4477-9338-7f71aaea87cb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:27.011296 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-289dee10-802e-4477-9338-7f71aaea87cb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:27.152237 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-289dee10-802e-4477-9338-7f71aaea87cb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb120cee6bf4ef4b7da15735f5f77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86aa99c129b476980f17821cd30ef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:27.159914 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-289dee10-802e-4477-9338-7f71aaea87cb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 200 len: 1265 microversion: 2.1 time: 0.163612 Sep 23 15:27:27.160500 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 432/862] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:26 2022] GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:28.182094 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-642e2028-9651-4dfd-834d-2e0fc3b67b28 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:28.182713 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-642e2028-9651-4dfd-834d-2e0fc3b67b28 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:28.191220 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-642e2028-9651-4dfd-834d-2e0fc3b67b28 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:28.191705 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-642e2028-9651-4dfd-834d-2e0fc3b67b28 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:28.192181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-642e2028-9651-4dfd-834d-2e0fc3b67b28 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:28.192883 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-642e2028-9651-4dfd-834d-2e0fc3b67b28 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:28.193337 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-642e2028-9651-4dfd-834d-2e0fc3b67b28 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:28.193761 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-642e2028-9651-4dfd-834d-2e0fc3b67b28 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:28.329353 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-642e2028-9651-4dfd-834d-2e0fc3b67b28 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb120cee6bf4ef4b7da15735f5f77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86aa99c129b476980f17821cd30ef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:28.339363 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-642e2028-9651-4dfd-834d-2e0fc3b67b28 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 200 len: 1265 microversion: 2.1 time: 0.160985 Sep 23 15:27:28.340297 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 431/863] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:28 2022] GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:28.378651 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-fc93eacc-9f7b-4b87-96ed-a9f661079107 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:28.379184 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-fc93eacc-9f7b-4b87-96ed-a9f661079107 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:28.385952 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fc93eacc-9f7b-4b87-96ed-a9f661079107 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:28.386437 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fc93eacc-9f7b-4b87-96ed-a9f661079107 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:28.386872 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fc93eacc-9f7b-4b87-96ed-a9f661079107 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:28.387605 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fc93eacc-9f7b-4b87-96ed-a9f661079107 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:28.388092 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fc93eacc-9f7b-4b87-96ed-a9f661079107 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:28.388538 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fc93eacc-9f7b-4b87-96ed-a9f661079107 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:28.402559 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-fc93eacc-9f7b-4b87-96ed-a9f661079107 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] HTTP exception thrown: Instance 3f41b2c1-177e-47f5-b7d5-48166096714c could not be found. Sep 23 15:27:28.404170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-fc93eacc-9f7b-4b87-96ed-a9f661079107 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Request method failure captured: Sep 23 15:27:28.404170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: DELETE /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c HTTP/1.1 Sep 23 15:27:28.404170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:27:28.404170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:27:28.404170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:27:28.404170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:27:28.404170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:27:28.404170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:27:28.404170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:27:28.404170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:27:28.404170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLc6pTJg1az4Ztuh3qoUewU2vUIYF2UNMVycjpGT92b5ptyf0bTzHt6IOxB68C19pjhprHNzQyPKZFOrJndeA8-qkVlagw5impOAkU-3NZNReUk5d3hfw0bnXnOe0zvPho_U3zxHsi2bLIkww6dgmrCSYkKMrcHNoBDM3NRpWyNJzlgk Sep 23 15:27:28.404170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:27:28.404170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:27:28.404170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:27:28.404170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:27:28.404170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:27:28.404170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:27:28.404170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: ab19e9f7cb0e49548a9ab74b9d2b4aec Sep 23 15:27:28.404170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-AttachVolumeTestJSON-1011211645 Sep 23 15:27:28.404170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:27:28.404170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:27:28.405611 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ab19e9f7cb0e49548a9ab74b9d2b4aec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ab19e9f7cb0e49548a9ab74b9d2b4aec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ab19e9f7cb0e49548a9ab74b9d2b4aec", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ab19e9f7cb0e49548a9ab74b9d2b4aec"}]}] Sep 23 15:27:28.405611 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-AttachVolumeTestJSON-1011211645 Sep 23 15:27:28.405611 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: ab19e9f7cb0e49548a9ab74b9d2b4aec Sep 23 15:27:28.405611 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1011211645 Sep 23 15:27:28.405611 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-AttachVolumeTestJSON-1011211645-project Sep 23 15:27:28.405611 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:27:28.405611 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:27:28.405611 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: f5f0ecaf38e74c96bc439fde75d93d37 Sep 23 15:27:28.405611 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-AttachVolumeTestJSON-1011211645-project Sep 23 15:27:28.405611 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:27:28.405611 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance 3f41b2c1-177e-47f5-b7d5-48166096714c could not be found. Sep 23 15:27:28.405611 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '3f41b2c1-177e-47f5-b7d5-48166096714c'} Sep 23 15:27:28.406965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:27:28.406965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:27:28.406965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:27:28.406965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:27:28.406965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:27:28.406965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:27:28.406965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:27:28.406965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:27:28.406965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:27:28.406965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:27:28.406965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f41b2c1-177e-47f5-b7d5-48166096714c could not be found. Sep 23 15:27:28.406965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:27:28.406965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:27:28.406965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:27:28.406965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:27:28.406965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:27:28.406965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:27:28.406965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:27:28.406965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:27:28.406965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:27:28.409165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:27:28.409165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 15:27:28.409165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 15:27:28.409165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 15:27:28.409165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 15:27:28.409165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:27:28.409165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:27:28.409165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:27:28.409165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:27:28.409165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f41b2c1-177e-47f5-b7d5-48166096714c could not be found. Sep 23 15:27:28.409165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:27:28.409165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:27:28.409165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:27:28.409165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:27:28.409165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:27:28.409165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:27:28.409165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:27:28.409165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:27:28.409165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f41b2c1-177e-47f5-b7d5-48166096714c could not be found. Sep 23 15:27:28.409165 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:27:28.411034 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-fc93eacc-9f7b-4b87-96ed-a9f661079107 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Returning 404 to user: Instance 3f41b2c1-177e-47f5-b7d5-48166096714c could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:27:28.411034 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-fc93eacc-9f7b-4b87-96ed-a9f661079107 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c" status: 404 len: 111 microversion: 2.1 time: 0.030936 Sep 23 15:27:28.411034 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 433/864] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Sep 23 15:27:28 2022] DELETE /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:27:28.415795 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6dd914bd-3192-4b69-bbe1-0fa5d2afd396 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:28.417697 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-6dd914bd-3192-4b69-bbe1-0fa5d2afd396 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 3f41b2c1-177e-47f5-b7d5-48166096714c] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:28.422703 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6dd914bd-3192-4b69-bbe1-0fa5d2afd396 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:28.423189 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6dd914bd-3192-4b69-bbe1-0fa5d2afd396 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:28.423627 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6dd914bd-3192-4b69-bbe1-0fa5d2afd396 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:28.425051 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6dd914bd-3192-4b69-bbe1-0fa5d2afd396 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:28.425513 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6dd914bd-3192-4b69-bbe1-0fa5d2afd396 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:28.425966 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6dd914bd-3192-4b69-bbe1-0fa5d2afd396 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:28.439909 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.wsgi [None req-6dd914bd-3192-4b69-bbe1-0fa5d2afd396 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] HTTP exception thrown: Instance 3f41b2c1-177e-47f5-b7d5-48166096714c could not be found. Sep 23 15:27:28.441592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6dd914bd-3192-4b69-bbe1-0fa5d2afd396 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Request method failure captured: Sep 23 15:27:28.441592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: request: GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c HTTP/1.1 Sep 23 15:27:28.441592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept: application/json Sep 23 15:27:28.441592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept-Encoding: identity Sep 23 15:27:28.441592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Connection: close Sep 23 15:27:28.441592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Length: 0 Sep 23 15:27:28.441592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Type: application/json Sep 23 15:27:28.441592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Host: 10.222.0.55 Sep 23 15:27:28.441592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Openstack-System-Scope: None Sep 23 15:27:28.441592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: User-Agent: python-urllib3/1.26.12 Sep 23 15:27:28.441592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Auth-Token: gAAAAABjLc6pTJg1az4Ztuh3qoUewU2vUIYF2UNMVycjpGT92b5ptyf0bTzHt6IOxB68C19pjhprHNzQyPKZFOrJndeA8-qkVlagw5impOAkU-3NZNReUk5d3hfw0bnXnOe0zvPho_U3zxHsi2bLIkww6dgmrCSYkKMrcHNoBDM3NRpWyNJzlgk Sep 23 15:27:28.441592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Id: None Sep 23 15:27:28.441592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Name: None Sep 23 15:27:28.441592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Identity-Status: Confirmed Sep 23 15:27:28.441592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Is-Admin-Project: True Sep 23 15:27:28.441592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Id: default Sep 23 15:27:28.441592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Name: Default Sep 23 15:27:28.441592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Id: ab19e9f7cb0e49548a9ab74b9d2b4aec Sep 23 15:27:28.441592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Name: tempest-AttachVolumeTestJSON-1011211645 Sep 23 15:27:28.441592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Role: reader,member Sep 23 15:27:28.441592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Roles: reader,member Sep 23 15:27:28.443327 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ab19e9f7cb0e49548a9ab74b9d2b4aec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ab19e9f7cb0e49548a9ab74b9d2b4aec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ab19e9f7cb0e49548a9ab74b9d2b4aec", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ab19e9f7cb0e49548a9ab74b9d2b4aec"}]}] Sep 23 15:27:28.443327 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant: tempest-AttachVolumeTestJSON-1011211645 Sep 23 15:27:28.443327 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Id: ab19e9f7cb0e49548a9ab74b9d2b4aec Sep 23 15:27:28.443327 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1011211645 Sep 23 15:27:28.443327 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User: tempest-AttachVolumeTestJSON-1011211645-project Sep 23 15:27:28.443327 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Id: default Sep 23 15:27:28.443327 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Name: Default Sep 23 15:27:28.443327 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Id: f5f0ecaf38e74c96bc439fde75d93d37 Sep 23 15:27:28.443327 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Name: tempest-AttachVolumeTestJSON-1011211645-project Sep 23 15:27:28.443327 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: method: > Sep 23 15:27:28.443327 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: exception: Instance 3f41b2c1-177e-47f5-b7d5-48166096714c could not be found. Sep 23 15:27:28.443327 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: action_args: {'id': '3f41b2c1-177e-47f5-b7d5-48166096714c'} Sep 23 15:27:28.444458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:27:28.444458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:27:28.444458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:27:28.444458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:27:28.444458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:27:28.444458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:27:28.444458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:27:28.444458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:27:28.444458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:27:28.444458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:27:28.444458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f41b2c1-177e-47f5-b7d5-48166096714c could not be found. Sep 23 15:27:28.444458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:27:28.444458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:27:28.444458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:27:28.444458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:27:28.444458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:27:28.444458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:27:28.444458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:27:28.444458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:27:28.444458 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:27:28.446013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:27:28.446013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:27:28.446013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:27:28.446013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:27:28.446013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:27:28.446013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:27:28.446013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:27:28.446013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f41b2c1-177e-47f5-b7d5-48166096714c could not be found. Sep 23 15:27:28.446013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:27:28.446013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:27:28.446013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:27:28.446013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:27:28.446013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:27:28.446013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:27:28.446013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:27:28.446013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:27:28.446013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f41b2c1-177e-47f5-b7d5-48166096714c could not be found. Sep 23 15:27:28.446013 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:27:28.450164 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6dd914bd-3192-4b69-bbe1-0fa5d2afd396 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Returning 404 to user: Instance 3f41b2c1-177e-47f5-b7d5-48166096714c could not be found. {{(pid=121448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:27:28.450164 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-6dd914bd-3192-4b69-bbe1-0fa5d2afd396 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c" status: 404 len: 111 microversion: 2.1 time: 0.031090 Sep 23 15:27:28.450164 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 432/865] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:28 2022] GET /compute/v2.1/servers/3f41b2c1-177e-47f5-b7d5-48166096714c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:27:29.370019 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-9d0976f6-95f2-422e-95bf-39a7bd5d348f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:29.370894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-9d0976f6-95f2-422e-95bf-39a7bd5d348f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:29.377216 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9d0976f6-95f2-422e-95bf-39a7bd5d348f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:29.377706 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9d0976f6-95f2-422e-95bf-39a7bd5d348f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:29.378148 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9d0976f6-95f2-422e-95bf-39a7bd5d348f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:29.378862 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9d0976f6-95f2-422e-95bf-39a7bd5d348f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:29.379479 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9d0976f6-95f2-422e-95bf-39a7bd5d348f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:29.379727 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9d0976f6-95f2-422e-95bf-39a7bd5d348f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:29.665044 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-9d0976f6-95f2-422e-95bf-39a7bd5d348f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb120cee6bf4ef4b7da15735f5f77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86aa99c129b476980f17821cd30ef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:29.673179 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-9d0976f6-95f2-422e-95bf-39a7bd5d348f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 200 len: 1265 microversion: 2.1 time: 0.307010 Sep 23 15:27:29.679829 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 434/866] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:29 2022] GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 1265 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:29.841465 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-844b1b34-a506-4ff9-ad95-e4e69c85460d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:29.841956 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-844b1b34-a506-4ff9-ad95-e4e69c85460d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:29.848785 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-844b1b34-a506-4ff9-ad95-e4e69c85460d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:29.849278 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-844b1b34-a506-4ff9-ad95-e4e69c85460d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:29.849721 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-844b1b34-a506-4ff9-ad95-e4e69c85460d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:29.850422 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-844b1b34-a506-4ff9-ad95-e4e69c85460d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:29.850883 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-844b1b34-a506-4ff9-ad95-e4e69c85460d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:29.851315 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-844b1b34-a506-4ff9-ad95-e4e69c85460d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:29.865174 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.wsgi [None req-844b1b34-a506-4ff9-ad95-e4e69c85460d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] HTTP exception thrown: Instance 1c5523ab-9085-47cd-9133-f65554b59f0f could not be found. Sep 23 15:27:29.866739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-844b1b34-a506-4ff9-ad95-e4e69c85460d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Request method failure captured: Sep 23 15:27:29.866739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: request: DELETE /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f HTTP/1.1 Sep 23 15:27:29.866739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept: application/json Sep 23 15:27:29.866739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept-Encoding: identity Sep 23 15:27:29.866739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Connection: close Sep 23 15:27:29.866739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Length: 0 Sep 23 15:27:29.866739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Type: application/json Sep 23 15:27:29.866739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Host: 10.222.0.55 Sep 23 15:27:29.866739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Openstack-System-Scope: None Sep 23 15:27:29.866739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: User-Agent: python-urllib3/1.26.12 Sep 23 15:27:29.866739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Auth-Token: gAAAAABjLc6pTJg1az4Ztuh3qoUewU2vUIYF2UNMVycjpGT92b5ptyf0bTzHt6IOxB68C19pjhprHNzQyPKZFOrJndeA8-qkVlagw5impOAkU-3NZNReUk5d3hfw0bnXnOe0zvPho_U3zxHsi2bLIkww6dgmrCSYkKMrcHNoBDM3NRpWyNJzlgk Sep 23 15:27:29.866739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Id: None Sep 23 15:27:29.866739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Name: None Sep 23 15:27:29.866739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Identity-Status: Confirmed Sep 23 15:27:29.866739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Is-Admin-Project: True Sep 23 15:27:29.866739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Id: default Sep 23 15:27:29.866739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Name: Default Sep 23 15:27:29.866739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Id: ab19e9f7cb0e49548a9ab74b9d2b4aec Sep 23 15:27:29.866739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Name: tempest-AttachVolumeTestJSON-1011211645 Sep 23 15:27:29.866739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Role: reader,member Sep 23 15:27:29.866739 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Roles: reader,member Sep 23 15:27:29.868335 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ab19e9f7cb0e49548a9ab74b9d2b4aec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ab19e9f7cb0e49548a9ab74b9d2b4aec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ab19e9f7cb0e49548a9ab74b9d2b4aec", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ab19e9f7cb0e49548a9ab74b9d2b4aec"}]}] Sep 23 15:27:29.868335 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant: tempest-AttachVolumeTestJSON-1011211645 Sep 23 15:27:29.868335 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Id: ab19e9f7cb0e49548a9ab74b9d2b4aec Sep 23 15:27:29.868335 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1011211645 Sep 23 15:27:29.868335 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User: tempest-AttachVolumeTestJSON-1011211645-project Sep 23 15:27:29.868335 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Id: default Sep 23 15:27:29.868335 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Name: Default Sep 23 15:27:29.868335 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Id: f5f0ecaf38e74c96bc439fde75d93d37 Sep 23 15:27:29.868335 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Name: tempest-AttachVolumeTestJSON-1011211645-project Sep 23 15:27:29.868335 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: method: > Sep 23 15:27:29.868335 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: exception: Instance 1c5523ab-9085-47cd-9133-f65554b59f0f could not be found. Sep 23 15:27:29.868335 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: action_args: {'id': '1c5523ab-9085-47cd-9133-f65554b59f0f'} Sep 23 15:27:29.869444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:27:29.869444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:27:29.869444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:27:29.869444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:27:29.869444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:27:29.869444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:27:29.869444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:27:29.869444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:27:29.869444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:27:29.869444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:27:29.869444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c5523ab-9085-47cd-9133-f65554b59f0f could not be found. Sep 23 15:27:29.869444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:27:29.869444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:27:29.869444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:27:29.869444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:27:29.869444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:27:29.869444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:27:29.869444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:27:29.869444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:27:29.869444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:27:29.871146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:27:29.871146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 15:27:29.871146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 15:27:29.871146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 15:27:29.871146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 15:27:29.871146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:27:29.871146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:27:29.871146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:27:29.871146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:27:29.871146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c5523ab-9085-47cd-9133-f65554b59f0f could not be found. Sep 23 15:27:29.871146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:27:29.871146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:27:29.871146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:27:29.871146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:27:29.871146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:27:29.871146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:27:29.871146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:27:29.871146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:27:29.871146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c5523ab-9085-47cd-9133-f65554b59f0f could not be found. Sep 23 15:27:29.871146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:27:29.872842 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-844b1b34-a506-4ff9-ad95-e4e69c85460d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Returning 404 to user: Instance 1c5523ab-9085-47cd-9133-f65554b59f0f could not be found. {{(pid=121448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:27:29.872842 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-844b1b34-a506-4ff9-ad95-e4e69c85460d tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "DELETE /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 404 len: 111 microversion: 2.1 time: 0.030512 Sep 23 15:27:29.872842 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 433/867] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Sep 23 15:27:29 2022] DELETE /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:27:29.876953 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-c97a387e-6d6b-4ae0-8874-6397257c1708 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:29.877571 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-c97a387e-6d6b-4ae0-8874-6397257c1708 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] [instance: 1c5523ab-9085-47cd-9133-f65554b59f0f] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:29.884661 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c97a387e-6d6b-4ae0-8874-6397257c1708 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:29.885151 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c97a387e-6d6b-4ae0-8874-6397257c1708 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:29.885588 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c97a387e-6d6b-4ae0-8874-6397257c1708 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:29.886278 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c97a387e-6d6b-4ae0-8874-6397257c1708 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:29.886731 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c97a387e-6d6b-4ae0-8874-6397257c1708 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:29.887152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c97a387e-6d6b-4ae0-8874-6397257c1708 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:29.901944 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-c97a387e-6d6b-4ae0-8874-6397257c1708 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] HTTP exception thrown: Instance 1c5523ab-9085-47cd-9133-f65554b59f0f could not be found. Sep 23 15:27:29.903463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-c97a387e-6d6b-4ae0-8874-6397257c1708 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Request method failure captured: Sep 23 15:27:29.903463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f HTTP/1.1 Sep 23 15:27:29.903463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:27:29.903463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:27:29.903463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:27:29.903463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:27:29.903463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:27:29.903463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:27:29.903463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:27:29.903463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:27:29.903463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLc6pTJg1az4Ztuh3qoUewU2vUIYF2UNMVycjpGT92b5ptyf0bTzHt6IOxB68C19pjhprHNzQyPKZFOrJndeA8-qkVlagw5impOAkU-3NZNReUk5d3hfw0bnXnOe0zvPho_U3zxHsi2bLIkww6dgmrCSYkKMrcHNoBDM3NRpWyNJzlgk Sep 23 15:27:29.903463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:27:29.903463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:27:29.903463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:27:29.903463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:27:29.903463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:27:29.903463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:27:29.903463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: ab19e9f7cb0e49548a9ab74b9d2b4aec Sep 23 15:27:29.903463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-AttachVolumeTestJSON-1011211645 Sep 23 15:27:29.903463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:27:29.903463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:27:29.905129 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ab19e9f7cb0e49548a9ab74b9d2b4aec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ab19e9f7cb0e49548a9ab74b9d2b4aec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ab19e9f7cb0e49548a9ab74b9d2b4aec", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ab19e9f7cb0e49548a9ab74b9d2b4aec"}]}] Sep 23 15:27:29.905129 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-AttachVolumeTestJSON-1011211645 Sep 23 15:27:29.905129 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: ab19e9f7cb0e49548a9ab74b9d2b4aec Sep 23 15:27:29.905129 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1011211645 Sep 23 15:27:29.905129 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-AttachVolumeTestJSON-1011211645-project Sep 23 15:27:29.905129 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:27:29.905129 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:27:29.905129 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: f5f0ecaf38e74c96bc439fde75d93d37 Sep 23 15:27:29.905129 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-AttachVolumeTestJSON-1011211645-project Sep 23 15:27:29.905129 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:27:29.905129 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance 1c5523ab-9085-47cd-9133-f65554b59f0f could not be found. Sep 23 15:27:29.905129 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '1c5523ab-9085-47cd-9133-f65554b59f0f'} Sep 23 15:27:29.906152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:27:29.906152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:27:29.906152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:27:29.906152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:27:29.906152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:27:29.906152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:27:29.906152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:27:29.906152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:27:29.906152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:27:29.906152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:27:29.906152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c5523ab-9085-47cd-9133-f65554b59f0f could not be found. Sep 23 15:27:29.906152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:27:29.906152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:27:29.906152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:27:29.906152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:27:29.906152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:27:29.906152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:27:29.906152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:27:29.906152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:27:29.906152 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:27:29.907692 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:27:29.907692 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:27:29.907692 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:27:29.907692 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:27:29.907692 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:27:29.907692 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:27:29.907692 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:27:29.907692 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c5523ab-9085-47cd-9133-f65554b59f0f could not be found. Sep 23 15:27:29.907692 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:27:29.907692 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:27:29.907692 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:27:29.907692 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:27:29.907692 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:27:29.907692 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:27:29.907692 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:27:29.907692 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:27:29.907692 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c5523ab-9085-47cd-9133-f65554b59f0f could not be found. Sep 23 15:27:29.907692 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:27:29.909210 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-c97a387e-6d6b-4ae0-8874-6397257c1708 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] Returning 404 to user: Instance 1c5523ab-9085-47cd-9133-f65554b59f0f could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:27:29.909210 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-c97a387e-6d6b-4ae0-8874-6397257c1708 tempest-AttachVolumeTestJSON-1011211645 tempest-AttachVolumeTestJSON-1011211645-project] 10.222.0.55 "GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f" status: 404 len: 111 microversion: 2.1 time: 0.031922 Sep 23 15:27:29.909210 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 435/868] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:29 2022] GET /compute/v2.1/servers/1c5523ab-9085-47cd-9133-f65554b59f0f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:27:30.696493 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-f40a4a4f-2201-4e33-937d-1f5147edbb8c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:30.697118 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-f40a4a4f-2201-4e33-937d-1f5147edbb8c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:30.703153 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f40a4a4f-2201-4e33-937d-1f5147edbb8c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:30.703642 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f40a4a4f-2201-4e33-937d-1f5147edbb8c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:30.704108 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f40a4a4f-2201-4e33-937d-1f5147edbb8c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:30.704813 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f40a4a4f-2201-4e33-937d-1f5147edbb8c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:30.705339 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f40a4a4f-2201-4e33-937d-1f5147edbb8c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:30.705779 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f40a4a4f-2201-4e33-937d-1f5147edbb8c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:30.709665 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:30.857233 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-f40a4a4f-2201-4e33-937d-1f5147edbb8c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb120cee6bf4ef4b7da15735f5f77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86aa99c129b476980f17821cd30ef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:30.865361 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-f40a4a4f-2201-4e33-937d-1f5147edbb8c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 200 len: 1265 microversion: 2.1 time: 0.173365 Sep 23 15:27:30.873138 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 434/869] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:30 2022] GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:31.892004 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-2ea91561-04b2-408a-b111-0b66c0ad4417 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:31.892004 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-2ea91561-04b2-408a-b111-0b66c0ad4417 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:31.908816 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2ea91561-04b2-408a-b111-0b66c0ad4417 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:31.909468 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2ea91561-04b2-408a-b111-0b66c0ad4417 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:31.909848 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2ea91561-04b2-408a-b111-0b66c0ad4417 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:31.913368 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2ea91561-04b2-408a-b111-0b66c0ad4417 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:31.913368 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2ea91561-04b2-408a-b111-0b66c0ad4417 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:31.913368 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2ea91561-04b2-408a-b111-0b66c0ad4417 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:32.066145 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-2ea91561-04b2-408a-b111-0b66c0ad4417 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb120cee6bf4ef4b7da15735f5f77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86aa99c129b476980f17821cd30ef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:32.078120 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-2ea91561-04b2-408a-b111-0b66c0ad4417 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 200 len: 1265 microversion: 2.1 time: 0.192103 Sep 23 15:27:32.078710 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 436/870] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:31 2022] GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:33.102639 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-3c2d4de1-d147-4e0f-89d3-11dee8064a2c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:33.103892 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-3c2d4de1-d147-4e0f-89d3-11dee8064a2c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:33.111584 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3c2d4de1-d147-4e0f-89d3-11dee8064a2c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:33.112094 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3c2d4de1-d147-4e0f-89d3-11dee8064a2c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:33.112543 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3c2d4de1-d147-4e0f-89d3-11dee8064a2c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:33.113296 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3c2d4de1-d147-4e0f-89d3-11dee8064a2c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:33.113822 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3c2d4de1-d147-4e0f-89d3-11dee8064a2c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:33.114251 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3c2d4de1-d147-4e0f-89d3-11dee8064a2c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:33.131920 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-9dba08f2-2a12-420c-b207-3bc492066bb5 req-7d9a95a8-c415-4b27-a8c0-93894cd6026c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ce91179-3e48-4016-881a-72a63aa9daf1", "name": "network-vif-plugged", "status": "completed", "tag": "c2205af8-7e2a-495b-8ea9-4dccb9d37b61"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:27:33.165944 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-9dba08f2-2a12-420c-b207-3bc492066bb5 req-7d9a95a8-c415-4b27-a8c0-93894cd6026c service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:33.165944 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-9dba08f2-2a12-420c-b207-3bc492066bb5 req-7d9a95a8-c415-4b27-a8c0-93894cd6026c service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:33.166301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-9dba08f2-2a12-420c-b207-3bc492066bb5 req-7d9a95a8-c415-4b27-a8c0-93894cd6026c service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:33.203451 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-9dba08f2-2a12-420c-b207-3bc492066bb5 req-7d9a95a8-c415-4b27-a8c0-93894cd6026c service nova] Creating event network-vif-plugged:c2205af8-7e2a-495b-8ea9-4dccb9d37b61 for instance 8ce91179-3e48-4016-881a-72a63aa9daf1 on hv-cinder-85530 Sep 23 15:27:33.218641 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-9dba08f2-2a12-420c-b207-3bc492066bb5 req-7d9a95a8-c415-4b27-a8c0-93894cd6026c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091254 Sep 23 15:27:33.219293 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 437/871] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:27:33.297261 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-3c2d4de1-d147-4e0f-89d3-11dee8064a2c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb120cee6bf4ef4b7da15735f5f77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86aa99c129b476980f17821cd30ef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:33.305986 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-3c2d4de1-d147-4e0f-89d3-11dee8064a2c tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 200 len: 1265 microversion: 2.1 time: 0.207290 Sep 23 15:27:33.308115 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 435/872] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:33 2022] GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:34.331060 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-7d007f05-24d7-4bec-8eb9-b937a69ccd6f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:34.332064 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-7d007f05-24d7-4bec-8eb9-b937a69ccd6f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:34.338814 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7d007f05-24d7-4bec-8eb9-b937a69ccd6f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:34.339327 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7d007f05-24d7-4bec-8eb9-b937a69ccd6f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:34.339766 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7d007f05-24d7-4bec-8eb9-b937a69ccd6f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:34.341113 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7d007f05-24d7-4bec-8eb9-b937a69ccd6f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:34.341763 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7d007f05-24d7-4bec-8eb9-b937a69ccd6f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:34.342202 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7d007f05-24d7-4bec-8eb9-b937a69ccd6f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:34.481005 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-7d007f05-24d7-4bec-8eb9-b937a69ccd6f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb120cee6bf4ef4b7da15735f5f77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86aa99c129b476980f17821cd30ef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:34.489722 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-7d007f05-24d7-4bec-8eb9-b937a69ccd6f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 200 len: 1265 microversion: 2.1 time: 0.162938 Sep 23 15:27:34.490385 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 438/873] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:34 2022] GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:35.513253 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-2b4dce07-b9e0-47c3-a85c-3fee4c5cc24d tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:35.513790 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-2b4dce07-b9e0-47c3-a85c-3fee4c5cc24d tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:35.519896 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2b4dce07-b9e0-47c3-a85c-3fee4c5cc24d tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:35.520416 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2b4dce07-b9e0-47c3-a85c-3fee4c5cc24d tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:35.520864 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2b4dce07-b9e0-47c3-a85c-3fee4c5cc24d tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:35.521556 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2b4dce07-b9e0-47c3-a85c-3fee4c5cc24d tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:35.522021 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2b4dce07-b9e0-47c3-a85c-3fee4c5cc24d tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:35.522550 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2b4dce07-b9e0-47c3-a85c-3fee4c5cc24d tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:35.658624 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-2b4dce07-b9e0-47c3-a85c-3fee4c5cc24d tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb120cee6bf4ef4b7da15735f5f77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86aa99c129b476980f17821cd30ef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:35.667473 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-2b4dce07-b9e0-47c3-a85c-3fee4c5cc24d tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 200 len: 1451 microversion: 2.1 time: 0.158078 Sep 23 15:27:35.668190 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 436/874] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:35 2022] GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:27:35.696809 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-9b931d88-a7bf-46bb-987d-95b34a5801d8 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:35.697430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-9b931d88-a7bf-46bb-987d-95b34a5801d8 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:35.704546 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9b931d88-a7bf-46bb-987d-95b34a5801d8 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:35.705040 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9b931d88-a7bf-46bb-987d-95b34a5801d8 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:35.705516 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9b931d88-a7bf-46bb-987d-95b34a5801d8 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:35.706252 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9b931d88-a7bf-46bb-987d-95b34a5801d8 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:35.706704 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9b931d88-a7bf-46bb-987d-95b34a5801d8 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:35.707126 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9b931d88-a7bf-46bb-987d-95b34a5801d8 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:35.848116 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-9b931d88-a7bf-46bb-987d-95b34a5801d8 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb120cee6bf4ef4b7da15735f5f77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86aa99c129b476980f17821cd30ef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:35.857066 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-9b931d88-a7bf-46bb-987d-95b34a5801d8 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 200 len: 1451 microversion: 2.1 time: 0.164774 Sep 23 15:27:35.857629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 439/875] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:35 2022] GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:38.542970 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-70c6bb64-22a5-4bd4-acde-99527ab7080c req-d2d66916-5adc-47a5-a4cd-d7459ee25a48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ce91179-3e48-4016-881a-72a63aa9daf1", "tag": "c2205af8-7e2a-495b-8ea9-4dccb9d37b61"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:27:38.553108 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-70c6bb64-22a5-4bd4-acde-99527ab7080c req-d2d66916-5adc-47a5-a4cd-d7459ee25a48 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:38.553670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-70c6bb64-22a5-4bd4-acde-99527ab7080c req-d2d66916-5adc-47a5-a4cd-d7459ee25a48 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:38.554170 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-70c6bb64-22a5-4bd4-acde-99527ab7080c req-d2d66916-5adc-47a5-a4cd-d7459ee25a48 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:38.566446 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-70c6bb64-22a5-4bd4-acde-99527ab7080c req-d2d66916-5adc-47a5-a4cd-d7459ee25a48 service nova] Creating event network-changed:c2205af8-7e2a-495b-8ea9-4dccb9d37b61 for instance 8ce91179-3e48-4016-881a-72a63aa9daf1 on hv-cinder-85530 Sep 23 15:27:38.571816 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-70c6bb64-22a5-4bd4-acde-99527ab7080c req-d2d66916-5adc-47a5-a4cd-d7459ee25a48 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033185 Sep 23 15:27:38.574205 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 437/876] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:27:38.965408 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-105f9001-e3d8-47c2-8e3f-f308cb298d28 tempest-VolumesTestJSON-1773678217 tempest-VolumesTestJSON-1773678217-project] Calling method '.version_select at 0x7f82db9ff5e0>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:39.025612 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-105f9001-e3d8-47c2-8e3f-f308cb298d28 tempest-VolumesTestJSON-1773678217 tempest-VolumesTestJSON-1773678217-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/8b0d8434-74f1-49e3-b22e-0a1efc9c927c" status: 200 len: 349 microversion: 2.1 time: 0.064799 Sep 23 15:27:39.034300 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 440/877] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Sep 23 15:27:38 2022] GET /compute/v2.1/os-volumes/8b0d8434-74f1-49e3-b22e-0a1efc9c927c => generated 349 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:27:40.958567 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-d7b34108-6bfd-4499-bb04-234a3d2461fc tempest-VolumesTestJSON-1773678217 tempest-VolumesTestJSON-1773678217-project] Calling method '.version_select at 0x7f82db94e3a0>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:41.009579 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-d7b34108-6bfd-4499-bb04-234a3d2461fc tempest-VolumesTestJSON-1773678217 tempest-VolumesTestJSON-1773678217-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/579114b5-e09e-470c-bf10-f6d9cb194d77" status: 200 len: 350 microversion: 2.1 time: 0.054661 Sep 23 15:27:41.010181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 438/878] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Sep 23 15:27:40 2022] GET /compute/v2.1/os-volumes/579114b5-e09e-470c-bf10-f6d9cb194d77 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:27:42.798576 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-91365146-1f05-4979-bdae-c1051c1d8808 tempest-VolumesTestJSON-1773678217 tempest-VolumesTestJSON-1773678217-project] Calling method '.version_select at 0x7f82db868e50>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:42.845801 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-91365146-1f05-4979-bdae-c1051c1d8808 tempest-VolumesTestJSON-1773678217 tempest-VolumesTestJSON-1773678217-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/06e93791-1d04-406b-9519-a3aa8ba8670f" status: 200 len: 351 microversion: 2.1 time: 0.051480 Sep 23 15:27:42.846489 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 441/879] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Sep 23 15:27:42 2022] GET /compute/v2.1/os-volumes/06e93791-1d04-406b-9519-a3aa8ba8670f => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:27:42.861837 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6d16ccbf-2f08-4fec-912b-5ab6edabe763 tempest-VolumesTestJSON-1773678217 tempest-VolumesTestJSON-1773678217-project] Calling method '.version_select at 0x7f82db9073a0>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:42.948439 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-6d16ccbf-2f08-4fec-912b-5ab6edabe763 tempest-VolumesTestJSON-1773678217 tempest-VolumesTestJSON-1773678217-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.090895 Sep 23 15:27:42.949015 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 439/880] 10.222.0.55 () {58 vars in 1134 bytes} [Fri Sep 23 15:27:42 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:42.964546 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-2cab6cb0-8a17-4c78-ab76-cca7a1e01f26 tempest-VolumesTestJSON-1773678217 tempest-VolumesTestJSON-1773678217-project] Calling method '.version_select at 0x7f82db8680d0>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:43.048991 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-2cab6cb0-8a17-4c78-ab76-cca7a1e01f26 tempest-VolumesTestJSON-1773678217 tempest-VolumesTestJSON-1773678217-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089432 Sep 23 15:27:43.049684 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 442/881] 10.222.0.55 () {58 vars in 1149 bytes} [Fri Sep 23 15:27:42 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:27:43.064611 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-1e2ff6e8-924e-4ffe-a484-2508cff53f71 tempest-VolumesTestJSON-1773678217 tempest-VolumesTestJSON-1773678217-project] Calling method '.version_select at 0x7f82db9b7700>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:43.151260 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-1e2ff6e8-924e-4ffe-a484-2508cff53f71 tempest-VolumesTestJSON-1773678217 tempest-VolumesTestJSON-1773678217-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.090613 Sep 23 15:27:43.151851 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 440/882] 10.222.0.55 () {58 vars in 1134 bytes} [Fri Sep 23 15:27:43 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:43.165205 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-cc420e09-4432-4587-bd86-39f05b542004 tempest-VolumesTestJSON-1773678217 tempest-VolumesTestJSON-1773678217-project] Calling method '.version_select at 0x7f82db7f8160>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:43.250952 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-cc420e09-4432-4587-bd86-39f05b542004 tempest-VolumesTestJSON-1773678217 tempest-VolumesTestJSON-1773678217-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088478 Sep 23 15:27:43.250952 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 443/883] 10.222.0.55 () {58 vars in 1167 bytes} [Fri Sep 23 15:27:43 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:27:43.266059 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-2487d17f-2a3b-423a-8527-b0571fdb3676 tempest-VolumesTestJSON-1773678217 tempest-VolumesTestJSON-1773678217-project] Calling method '.version_select at 0x7f82db94e5e0>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:43.354550 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-2487d17f-2a3b-423a-8527-b0571fdb3676 tempest-VolumesTestJSON-1773678217 tempest-VolumesTestJSON-1773678217-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.092405 Sep 23 15:27:43.360099 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 441/884] 10.222.0.55 () {58 vars in 1170 bytes} [Fri Sep 23 15:27:43 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:27:43.373755 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-e51903c2-7028-4bbf-ab68-de2825a9620a tempest-VolumesTestJSON-1773678217 tempest-VolumesTestJSON-1773678217-project] Calling method '.version_select at 0x7f82db85c9d0>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:43.455744 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-e51903c2-7028-4bbf-ab68-de2825a9620a tempest-VolumesTestJSON-1773678217 tempest-VolumesTestJSON-1773678217-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.085958 Sep 23 15:27:43.456355 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 444/885] 10.222.0.55 () {58 vars in 1155 bytes} [Fri Sep 23 15:27:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:43.471044 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-26998a1e-6ac9-4e3b-8b59-50ee0896a77e tempest-VolumesTestJSON-1773678217 tempest-VolumesTestJSON-1773678217-project] Calling method '.version_select at 0x7f82db9940d0>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:43.552648 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-26998a1e-6ac9-4e3b-8b59-50ee0896a77e tempest-VolumesTestJSON-1773678217 tempest-VolumesTestJSON-1773678217-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085264 Sep 23 15:27:43.553248 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 442/886] 10.222.0.55 () {58 vars in 1188 bytes} [Fri Sep 23 15:27:43 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:27:43.567934 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-c5460d67-6596-42bc-9336-dfac001d30c8 tempest-VolumesTestJSON-1773678217 tempest-VolumesTestJSON-1773678217-project] Calling method '.version_select at 0x7f82db91c280>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:43.654201 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-c5460d67-6596-42bc-9336-dfac001d30c8 tempest-VolumesTestJSON-1773678217 tempest-VolumesTestJSON-1773678217-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.089907 Sep 23 15:27:43.654811 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 445/887] 10.222.0.55 () {58 vars in 1155 bytes} [Fri Sep 23 15:27:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:52.052841 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:52.053610 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=19 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:52.058561 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-89dd6406-f277-4d33-a0b3-3f4b70500a45 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:52.060953 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-89dd6406-f277-4d33-a0b3-3f4b70500a45 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:52.067358 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-89dd6406-f277-4d33-a0b3-3f4b70500a45 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:52.068177 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-89dd6406-f277-4d33-a0b3-3f4b70500a45 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:52.068716 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-89dd6406-f277-4d33-a0b3-3f4b70500a45 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:52.069484 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-89dd6406-f277-4d33-a0b3-3f4b70500a45 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:52.070159 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-89dd6406-f277-4d33-a0b3-3f4b70500a45 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:52.070825 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-89dd6406-f277-4d33-a0b3-3f4b70500a45 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:52.103240 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-89dd6406-f277-4d33-a0b3-3f4b70500a45 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051160 Sep 23 15:27:52.104431 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 443/888] 10.222.0.55 () {60 vars in 1343 bytes} [Fri Sep 23 15:27:52 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:52.174830 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-80caaa70-81b6-4c58-bf84-b7a8223bcd2e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:52.175870 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-80caaa70-81b6-4c58-bf84-b7a8223bcd2e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:52.177107 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-ff8ab770-3c3b-4de2-b7ba-420349d42df8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:52.177928 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-ff8ab770-3c3b-4de2-b7ba-420349d42df8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:52.182995 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:52.183660 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=54 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:52.185128 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-80caaa70-81b6-4c58-bf84-b7a8223bcd2e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:52.185796 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-80caaa70-81b6-4c58-bf84-b7a8223bcd2e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:52.185925 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ff8ab770-3c3b-4de2-b7ba-420349d42df8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:52.186427 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ff8ab770-3c3b-4de2-b7ba-420349d42df8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:52.186683 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-80caaa70-81b6-4c58-bf84-b7a8223bcd2e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:52.186867 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ff8ab770-3c3b-4de2-b7ba-420349d42df8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:52.187583 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ff8ab770-3c3b-4de2-b7ba-420349d42df8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:52.187893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-80caaa70-81b6-4c58-bf84-b7a8223bcd2e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:52.188095 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ff8ab770-3c3b-4de2-b7ba-420349d42df8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:52.188504 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ff8ab770-3c3b-4de2-b7ba-420349d42df8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:52.188755 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-80caaa70-81b6-4c58-bf84-b7a8223bcd2e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:52.189242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-80caaa70-81b6-4c58-bf84-b7a8223bcd2e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:52.216624 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-ff8ab770-3c3b-4de2-b7ba-420349d42df8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Going to try to terminate instance {{(pid=121448) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:27:52.220114 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-80caaa70-81b6-4c58-bf84-b7a8223bcd2e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Going to try to terminate instance {{(pid=121450) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:27:52.718941 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-ff8ab770-3c3b-4de2-b7ba-420349d42df8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "DELETE /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 204 len: 0 microversion: 2.1 time: 0.545634 Sep 23 15:27:52.720975 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 444/889] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Sep 23 15:27:52 2022] DELETE /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 0 bytes in 547 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:27:52.725363 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-1a9a9141-fe21-4e81-859d-5857b6c10d53 req-b52e7054-0ddd-4122-91b3-fcee64261bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74b48a2a-0dde-4289-b8d6-788a66dafddb", "tag": "0c8439ba-0b08-4cad-8937-aa360e2a93ed"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:27:52.735587 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-1a9a9141-fe21-4e81-859d-5857b6c10d53 req-b52e7054-0ddd-4122-91b3-fcee64261bb6 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:52.736101 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-1a9a9141-fe21-4e81-859d-5857b6c10d53 req-b52e7054-0ddd-4122-91b3-fcee64261bb6 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:52.736542 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-1a9a9141-fe21-4e81-859d-5857b6c10d53 req-b52e7054-0ddd-4122-91b3-fcee64261bb6 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:52.748321 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-1a9a9141-fe21-4e81-859d-5857b6c10d53 req-b52e7054-0ddd-4122-91b3-fcee64261bb6 service nova] Creating event network-changed:0c8439ba-0b08-4cad-8937-aa360e2a93ed for instance 74b48a2a-0dde-4289-b8d6-788a66dafddb on hv-cinder-85530 Sep 23 15:27:52.753593 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-1a9a9141-fe21-4e81-859d-5857b6c10d53 req-b52e7054-0ddd-4122-91b3-fcee64261bb6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032557 Sep 23 15:27:52.754368 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 445/890] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:27:52.759927 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-0c2e4efa-c6d5-42a7-bf67-bd23e3fd12f7 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:52.760768 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-0c2e4efa-c6d5-42a7-bf67-bd23e3fd12f7 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:52.767151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0c2e4efa-c6d5-42a7-bf67-bd23e3fd12f7 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:52.767633 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0c2e4efa-c6d5-42a7-bf67-bd23e3fd12f7 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:52.768096 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0c2e4efa-c6d5-42a7-bf67-bd23e3fd12f7 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:52.768796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0c2e4efa-c6d5-42a7-bf67-bd23e3fd12f7 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:52.769258 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0c2e4efa-c6d5-42a7-bf67-bd23e3fd12f7 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:52.769683 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-0c2e4efa-c6d5-42a7-bf67-bd23e3fd12f7 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:52.793062 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-80caaa70-81b6-4c58-bf84-b7a8223bcd2e tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "DELETE /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 204 len: 0 microversion: 2.20 time: 0.621742 Sep 23 15:27:52.794275 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 446/891] 10.222.0.55 () {60 vars in 1280 bytes} [Fri Sep 23 15:27:52 2022] DELETE /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 15:27:52.804219 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-42089586-f5bd-4c74-940b-5f2dbc316016 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:52.805352 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-42089586-f5bd-4c74-940b-5f2dbc316016 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:52.812741 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-42089586-f5bd-4c74-940b-5f2dbc316016 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:52.813584 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-42089586-f5bd-4c74-940b-5f2dbc316016 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:52.814030 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-42089586-f5bd-4c74-940b-5f2dbc316016 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:52.814738 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-42089586-f5bd-4c74-940b-5f2dbc316016 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:52.815266 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-42089586-f5bd-4c74-940b-5f2dbc316016 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:52.815714 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-42089586-f5bd-4c74-940b-5f2dbc316016 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:52.932119 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-0c2e4efa-c6d5-42a7-bf67-bd23e3fd12f7 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:52.942246 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-0c2e4efa-c6d5-42a7-bf67-bd23e3fd12f7 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1569 microversion: 2.1 time: 0.186819 Sep 23 15:27:52.943206 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 446/892] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:52 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:52.969735 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-42089586-f5bd-4c74-940b-5f2dbc316016 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:52.980562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-42089586-f5bd-4c74-940b-5f2dbc316016 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:52.982548 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-42089586-f5bd-4c74-940b-5f2dbc316016 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:52.983814 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-42089586-f5bd-4c74-940b-5f2dbc316016 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1723 microversion: 2.20 time: 0.184805 Sep 23 15:27:52.984918 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 447/893] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:52 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:53.966994 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-e9795fa0-2dd6-402d-b153-4d8727db0fba tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:53.967612 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-e9795fa0-2dd6-402d-b153-4d8727db0fba tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:53.974012 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e9795fa0-2dd6-402d-b153-4d8727db0fba tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:53.975605 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e9795fa0-2dd6-402d-b153-4d8727db0fba tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:53.975605 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e9795fa0-2dd6-402d-b153-4d8727db0fba tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:53.975605 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e9795fa0-2dd6-402d-b153-4d8727db0fba tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:53.976058 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e9795fa0-2dd6-402d-b153-4d8727db0fba tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:53.976488 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e9795fa0-2dd6-402d-b153-4d8727db0fba tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:54.017202 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-6fc1d76b-48b4-4728-816c-0fa162dd4da2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:54.017824 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-6fc1d76b-48b4-4728-816c-0fa162dd4da2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:54.030686 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6fc1d76b-48b4-4728-816c-0fa162dd4da2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:54.032136 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6fc1d76b-48b4-4728-816c-0fa162dd4da2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:54.032603 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6fc1d76b-48b4-4728-816c-0fa162dd4da2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:54.033344 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6fc1d76b-48b4-4728-816c-0fa162dd4da2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:54.033826 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6fc1d76b-48b4-4728-816c-0fa162dd4da2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:54.034255 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6fc1d76b-48b4-4728-816c-0fa162dd4da2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:54.213906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-6fc1d76b-48b4-4728-816c-0fa162dd4da2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:54.233786 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-6fc1d76b-48b4-4728-816c-0fa162dd4da2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:54.233786 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-6fc1d76b-48b4-4728-816c-0fa162dd4da2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:54.233786 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-6fc1d76b-48b4-4728-816c-0fa162dd4da2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1723 microversion: 2.20 time: 0.221731 Sep 23 15:27:54.234081 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 448/894] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:54 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:54.286265 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-e9795fa0-2dd6-402d-b153-4d8727db0fba tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:54.295520 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-e9795fa0-2dd6-402d-b153-4d8727db0fba tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1569 microversion: 2.1 time: 0.333156 Sep 23 15:27:54.299864 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 447/895] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:53 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1569 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:55.258179 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-32d8aec0-71d6-4602-916c-81017af649dd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:55.259374 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-32d8aec0-71d6-4602-916c-81017af649dd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:55.266846 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-32d8aec0-71d6-4602-916c-81017af649dd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:55.267470 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-32d8aec0-71d6-4602-916c-81017af649dd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:55.267969 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-32d8aec0-71d6-4602-916c-81017af649dd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:55.268742 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-32d8aec0-71d6-4602-916c-81017af649dd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:55.269202 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-32d8aec0-71d6-4602-916c-81017af649dd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:55.269631 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-32d8aec0-71d6-4602-916c-81017af649dd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:55.323574 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-c72ae583-fcd5-4b96-9770-074a1e46b326 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:55.325579 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-c72ae583-fcd5-4b96-9770-074a1e46b326 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:55.332784 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c72ae583-fcd5-4b96-9770-074a1e46b326 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:55.333396 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c72ae583-fcd5-4b96-9770-074a1e46b326 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:55.334131 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c72ae583-fcd5-4b96-9770-074a1e46b326 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:55.334942 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c72ae583-fcd5-4b96-9770-074a1e46b326 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:55.335606 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c72ae583-fcd5-4b96-9770-074a1e46b326 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:55.336323 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c72ae583-fcd5-4b96-9770-074a1e46b326 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:55.482934 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-c72ae583-fcd5-4b96-9770-074a1e46b326 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:55.491603 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-c72ae583-fcd5-4b96-9770-074a1e46b326 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1569 microversion: 2.1 time: 0.173054 Sep 23 15:27:55.492223 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 448/896] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:55 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:27:55.706256 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-32d8aec0-71d6-4602-916c-81017af649dd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:55.715296 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-32d8aec0-71d6-4602-916c-81017af649dd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:55.716793 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-32d8aec0-71d6-4602-916c-81017af649dd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:55.717948 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-32d8aec0-71d6-4602-916c-81017af649dd tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1723 microversion: 2.20 time: 0.463801 Sep 23 15:27:55.718506 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 449/897] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:55 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1723 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:56.515084 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-c77a2ddf-ba1b-4f53-8223-70d9369d385b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:56.515725 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-c77a2ddf-ba1b-4f53-8223-70d9369d385b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:56.522501 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c77a2ddf-ba1b-4f53-8223-70d9369d385b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:56.522987 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c77a2ddf-ba1b-4f53-8223-70d9369d385b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:56.523446 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c77a2ddf-ba1b-4f53-8223-70d9369d385b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:56.524278 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c77a2ddf-ba1b-4f53-8223-70d9369d385b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:56.525385 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c77a2ddf-ba1b-4f53-8223-70d9369d385b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:56.525827 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c77a2ddf-ba1b-4f53-8223-70d9369d385b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:56.676204 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-c77a2ddf-ba1b-4f53-8223-70d9369d385b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:56.685297 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-c77a2ddf-ba1b-4f53-8223-70d9369d385b tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1569 microversion: 2.1 time: 0.174063 Sep 23 15:27:56.685881 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 449/898] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:56 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:56.746509 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-0f0e09d0-10a6-4cd8-b13f-33e44530cc75 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:56.747300 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-0f0e09d0-10a6-4cd8-b13f-33e44530cc75 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:56.753527 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0f0e09d0-10a6-4cd8-b13f-33e44530cc75 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:56.754019 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0f0e09d0-10a6-4cd8-b13f-33e44530cc75 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:56.754459 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0f0e09d0-10a6-4cd8-b13f-33e44530cc75 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:56.755858 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0f0e09d0-10a6-4cd8-b13f-33e44530cc75 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:56.756659 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0f0e09d0-10a6-4cd8-b13f-33e44530cc75 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:56.757343 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0f0e09d0-10a6-4cd8-b13f-33e44530cc75 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:56.892073 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-4baa3a8c-5a44-462e-bfe2-5de4c0ed8c98 req-f66651c2-e832-4233-bed2-8626662d79b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74b48a2a-0dde-4289-b8d6-788a66dafddb", "name": "network-vif-deleted", "tag": "0c8439ba-0b08-4cad-8937-aa360e2a93ed"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:27:56.904131 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-4baa3a8c-5a44-462e-bfe2-5de4c0ed8c98 req-f66651c2-e832-4233-bed2-8626662d79b7 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:56.904131 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-4baa3a8c-5a44-462e-bfe2-5de4c0ed8c98 req-f66651c2-e832-4233-bed2-8626662d79b7 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:56.904131 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-4baa3a8c-5a44-462e-bfe2-5de4c0ed8c98 req-f66651c2-e832-4233-bed2-8626662d79b7 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:56.915785 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-4baa3a8c-5a44-462e-bfe2-5de4c0ed8c98 req-f66651c2-e832-4233-bed2-8626662d79b7 service nova] Creating event network-vif-deleted:0c8439ba-0b08-4cad-8937-aa360e2a93ed for instance 74b48a2a-0dde-4289-b8d6-788a66dafddb on hv-cinder-85530 Sep 23 15:27:56.921207 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-4baa3a8c-5a44-462e-bfe2-5de4c0ed8c98 req-f66651c2-e832-4233-bed2-8626662d79b7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034380 Sep 23 15:27:56.922229 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 450/899] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:27:56.992658 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-0f0e09d0-10a6-4cd8-b13f-33e44530cc75 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:57.003462 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-0f0e09d0-10a6-4cd8-b13f-33e44530cc75 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:57.004928 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-0f0e09d0-10a6-4cd8-b13f-33e44530cc75 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:57.006102 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-0f0e09d0-10a6-4cd8-b13f-33e44530cc75 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1723 microversion: 2.20 time: 0.265750 Sep 23 15:27:57.006659 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 450/900] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:56 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:57.819894 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-e050993b-8e39-4231-9a65-356bf4f813e8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:57.819894 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-e050993b-8e39-4231-9a65-356bf4f813e8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:57.819894 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e050993b-8e39-4231-9a65-356bf4f813e8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:57.819894 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e050993b-8e39-4231-9a65-356bf4f813e8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:57.821833 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e050993b-8e39-4231-9a65-356bf4f813e8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:57.821833 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e050993b-8e39-4231-9a65-356bf4f813e8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:57.821833 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e050993b-8e39-4231-9a65-356bf4f813e8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:57.821833 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-e050993b-8e39-4231-9a65-356bf4f813e8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:57.822589 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-e050993b-8e39-4231-9a65-356bf4f813e8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:57.822589 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-e050993b-8e39-4231-9a65-356bf4f813e8 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1220 microversion: 2.1 time: 0.093956 Sep 23 15:27:57.822589 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 451/901] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:57 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:58.030806 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-45b022c0-d07d-4491-a345-e74e871db88c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:58.031452 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-45b022c0-d07d-4491-a345-e74e871db88c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:58.038032 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-45b022c0-d07d-4491-a345-e74e871db88c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:58.038521 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-45b022c0-d07d-4491-a345-e74e871db88c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:58.038962 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-45b022c0-d07d-4491-a345-e74e871db88c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:58.039662 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-45b022c0-d07d-4491-a345-e74e871db88c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:58.040706 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-45b022c0-d07d-4491-a345-e74e871db88c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:58.041281 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-45b022c0-d07d-4491-a345-e74e871db88c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:58.083761 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-45b022c0-d07d-4491-a345-e74e871db88c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:58.083761 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-45b022c0-d07d-4491-a345-e74e871db88c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:58.083761 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-45b022c0-d07d-4491-a345-e74e871db88c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:58.083761 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.objects.instance [None req-45b022c0-d07d-4491-a345-e74e871db88c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lazy-loading 'fault' on Instance uuid 46eb43e1-8a8e-4c5e-a071-ef900f024b55 {{(pid=121450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:27:58.123346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-45b022c0-d07d-4491-a345-e74e871db88c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:58.132105 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-45b022c0-d07d-4491-a345-e74e871db88c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:58.135376 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-45b022c0-d07d-4491-a345-e74e871db88c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42dc378333ae4bbdbd42ce041ba15d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1679242155f94d48871525425f74d1c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:58.135538 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-45b022c0-d07d-4491-a345-e74e871db88c tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 200 len: 1370 microversion: 2.20 time: 0.108427 Sep 23 15:27:58.136379 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 451/902] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:58 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 1370 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:58.822807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-b69bbc3f-08f4-40d9-93ff-5d056d10bba1 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:58.823362 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-b69bbc3f-08f4-40d9-93ff-5d056d10bba1 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:58.830299 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b69bbc3f-08f4-40d9-93ff-5d056d10bba1 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:58.830794 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b69bbc3f-08f4-40d9-93ff-5d056d10bba1 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:58.831240 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b69bbc3f-08f4-40d9-93ff-5d056d10bba1 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:58.832030 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b69bbc3f-08f4-40d9-93ff-5d056d10bba1 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:58.832542 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b69bbc3f-08f4-40d9-93ff-5d056d10bba1 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:58.833015 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b69bbc3f-08f4-40d9-93ff-5d056d10bba1 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:58.865251 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b69bbc3f-08f4-40d9-93ff-5d056d10bba1 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:58.865744 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b69bbc3f-08f4-40d9-93ff-5d056d10bba1 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:58.866184 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-b69bbc3f-08f4-40d9-93ff-5d056d10bba1 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:58.866637 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.objects.instance [None req-b69bbc3f-08f4-40d9-93ff-5d056d10bba1 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lazy-loading 'fault' on Instance uuid 74b48a2a-0dde-4289-b8d6-788a66dafddb {{(pid=121448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:27:58.909853 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-b69bbc3f-08f4-40d9-93ff-5d056d10bba1 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdaecd5dd5d461383878c4b96ef98be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c95b871ff2b4ed89195a9c0fa94e8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:58.917704 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-b69bbc3f-08f4-40d9-93ff-5d056d10bba1 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 200 len: 1179 microversion: 2.1 time: 0.098804 Sep 23 15:27:58.918573 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 452/903] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:58 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 1179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:58.936583 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-ebd81144-d527-46ef-bea3-f854fc07fe4b req-bfbd27ae-eebf-4e70-bc41-56baac92d5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46eb43e1-8a8e-4c5e-a071-ef900f024b55", "name": "network-vif-deleted", "tag": "372595b3-5ccc-49a2-81d3-b61302bfa68d"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:27:58.946231 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-ebd81144-d527-46ef-bea3-f854fc07fe4b req-bfbd27ae-eebf-4e70-bc41-56baac92d5e6 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:58.946706 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-ebd81144-d527-46ef-bea3-f854fc07fe4b req-bfbd27ae-eebf-4e70-bc41-56baac92d5e6 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:58.947131 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-ebd81144-d527-46ef-bea3-f854fc07fe4b req-bfbd27ae-eebf-4e70-bc41-56baac92d5e6 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:58.970124 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-ebd81144-d527-46ef-bea3-f854fc07fe4b req-bfbd27ae-eebf-4e70-bc41-56baac92d5e6 service nova] Creating event network-vif-deleted:372595b3-5ccc-49a2-81d3-b61302bfa68d for instance 46eb43e1-8a8e-4c5e-a071-ef900f024b55 on hv-cinder-85530 Sep 23 15:27:58.975448 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-ebd81144-d527-46ef-bea3-f854fc07fe4b req-bfbd27ae-eebf-4e70-bc41-56baac92d5e6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042350 Sep 23 15:27:58.976277 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 452/904] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:27:59.162075 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-3d8c83c9-1a81-40e0-9b44-6c3c6ed38fe2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:59.162686 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-3d8c83c9-1a81-40e0-9b44-6c3c6ed38fe2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:59.169250 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3d8c83c9-1a81-40e0-9b44-6c3c6ed38fe2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:59.169731 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3d8c83c9-1a81-40e0-9b44-6c3c6ed38fe2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:59.170162 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3d8c83c9-1a81-40e0-9b44-6c3c6ed38fe2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:59.170867 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3d8c83c9-1a81-40e0-9b44-6c3c6ed38fe2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:59.171325 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3d8c83c9-1a81-40e0-9b44-6c3c6ed38fe2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:59.171744 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3d8c83c9-1a81-40e0-9b44-6c3c6ed38fe2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:59.186979 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.wsgi [None req-3d8c83c9-1a81-40e0-9b44-6c3c6ed38fe2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] HTTP exception thrown: Instance 46eb43e1-8a8e-4c5e-a071-ef900f024b55 could not be found. Sep 23 15:27:59.188670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-3d8c83c9-1a81-40e0-9b44-6c3c6ed38fe2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Request method failure captured: Sep 23 15:27:59.188670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: request: GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 HTTP/1.1 Sep 23 15:27:59.188670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept: application/json Sep 23 15:27:59.188670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept-Encoding: identity Sep 23 15:27:59.188670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Connection: close Sep 23 15:27:59.188670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Length: 0 Sep 23 15:27:59.188670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Type: application/json Sep 23 15:27:59.188670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Host: 10.222.0.55 Sep 23 15:27:59.188670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Openstack-System-Scope: None Sep 23 15:27:59.188670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: User-Agent: python-urllib3/1.26.12 Sep 23 15:27:59.188670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Auth-Token: gAAAAABjLc6z5kX1NEdHC6q7BE3PXHLC5hIbEvdxDuXJ-X67qALlq5AFtNCX-mZWdpg8QXGj5SSi_JNV7yaeFmAAigIOxU2VVo0zoWq9DJ2abmiYqd5JEynIIq4T4UokqINUY0YwH-DT_W-iv8-833WO-050zX4ajLVUGKHy5mpN7dgy9E-DAaY Sep 23 15:27:59.188670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Id: None Sep 23 15:27:59.188670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Name: None Sep 23 15:27:59.188670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Identity-Status: Confirmed Sep 23 15:27:59.188670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Is-Admin-Project: True Sep 23 15:27:59.188670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 15:27:59.188670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Id: default Sep 23 15:27:59.188670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Name: Default Sep 23 15:27:59.188670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Id: 1679242155f94d48871525425f74d1c3 Sep 23 15:27:59.188670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-731499941 Sep 23 15:27:59.188670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Role: reader,member Sep 23 15:27:59.188670 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Roles: reader,member Sep 23 15:27:59.190623 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1679242155f94d48871525425f74d1c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1679242155f94d48871525425f74d1c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1679242155f94d48871525425f74d1c3", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1679242155f94d48871525425f74d1c3"}]}] Sep 23 15:27:59.190623 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant: tempest-AttachVolumeShelveTestJSON-731499941 Sep 23 15:27:59.190623 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Id: 1679242155f94d48871525425f74d1c3 Sep 23 15:27:59.190623 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-731499941 Sep 23 15:27:59.190623 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User: tempest-AttachVolumeShelveTestJSON-731499941-project Sep 23 15:27:59.190623 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Id: default Sep 23 15:27:59.190623 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Name: Default Sep 23 15:27:59.190623 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Id: 42dc378333ae4bbdbd42ce041ba15d3f Sep 23 15:27:59.190623 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Name: tempest-AttachVolumeShelveTestJSON-731499941-project Sep 23 15:27:59.190623 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: method: > Sep 23 15:27:59.190623 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: exception: Instance 46eb43e1-8a8e-4c5e-a071-ef900f024b55 could not be found. Sep 23 15:27:59.190623 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: action_args: {'id': '46eb43e1-8a8e-4c5e-a071-ef900f024b55'} Sep 23 15:27:59.191807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:27:59.191807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:27:59.191807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:27:59.191807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:27:59.191807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:27:59.191807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:27:59.191807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:27:59.191807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:27:59.191807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:27:59.191807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:27:59.191807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46eb43e1-8a8e-4c5e-a071-ef900f024b55 could not be found. Sep 23 15:27:59.191807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:27:59.191807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:27:59.191807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:27:59.191807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:27:59.191807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:27:59.191807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:27:59.191807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:27:59.191807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:27:59.191807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:27:59.193525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:27:59.193525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:27:59.193525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:27:59.193525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:27:59.193525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:27:59.193525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:27:59.193525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:27:59.193525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46eb43e1-8a8e-4c5e-a071-ef900f024b55 could not be found. Sep 23 15:27:59.193525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:27:59.193525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:27:59.193525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:27:59.193525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:27:59.193525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:27:59.193525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:27:59.193525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:27:59.193525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:27:59.193525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46eb43e1-8a8e-4c5e-a071-ef900f024b55 could not be found. Sep 23 15:27:59.193525 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:27:59.195148 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-3d8c83c9-1a81-40e0-9b44-6c3c6ed38fe2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Returning 404 to user: Instance 46eb43e1-8a8e-4c5e-a071-ef900f024b55 could not be found. {{(pid=121448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:27:59.195148 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-3d8c83c9-1a81-40e0-9b44-6c3c6ed38fe2 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 404 len: 111 microversion: 2.20 time: 0.032034 Sep 23 15:27:59.195148 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 453/905] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:59 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 15:27:59.200189 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-2dd0bb9b-5544-486f-810c-3286e15c87bf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '.version_select at 0x7f82db8fdd30>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:59.354784 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-2dd0bb9b-5544-486f-810c-3286e15c87bf tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-884697376" status: 204 len: 0 microversion: 2.20 time: 0.159255 Sep 23 15:27:59.355296 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 453/906] 10.222.0.55 () {60 vars in 1259 bytes} [Fri Sep 23 15:27:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-884697376 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 23 15:27:59.941653 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-054d28b1-428a-4951-af7e-729b8855e5b4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:59.942211 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-054d28b1-428a-4951-af7e-729b8855e5b4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] [instance: 74b48a2a-0dde-4289-b8d6-788a66dafddb] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:59.948610 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-054d28b1-428a-4951-af7e-729b8855e5b4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:59.949090 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-054d28b1-428a-4951-af7e-729b8855e5b4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:59.949520 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-054d28b1-428a-4951-af7e-729b8855e5b4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:59.950232 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-054d28b1-428a-4951-af7e-729b8855e5b4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:59.950685 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-054d28b1-428a-4951-af7e-729b8855e5b4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:59.951111 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-054d28b1-428a-4951-af7e-729b8855e5b4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:59.968851 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.wsgi [None req-054d28b1-428a-4951-af7e-729b8855e5b4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] HTTP exception thrown: Instance 74b48a2a-0dde-4289-b8d6-788a66dafddb could not be found. Sep 23 15:27:59.970796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-054d28b1-428a-4951-af7e-729b8855e5b4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Request method failure captured: Sep 23 15:27:59.970796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: request: GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb HTTP/1.1 Sep 23 15:27:59.970796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept: application/json Sep 23 15:27:59.970796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept-Encoding: identity Sep 23 15:27:59.970796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Connection: close Sep 23 15:27:59.970796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Length: 0 Sep 23 15:27:59.970796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Type: application/json Sep 23 15:27:59.970796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Host: 10.222.0.55 Sep 23 15:27:59.970796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Openstack-System-Scope: None Sep 23 15:27:59.970796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: User-Agent: python-urllib3/1.26.12 Sep 23 15:27:59.970796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Auth-Token: gAAAAABjLc8oq2R7JRsyFdBc1xpWBlmlRtFGlJFkiLGSxFMFA0evX2ZpDfSzUzIOEksaX-yID2DxRSbdumXL3o592nSTocQoKexx-1T35ZylADcjb669RLyA692HaJt_MTYsdkHR-u5d_TsBUcox7Uu1meMvHdVOaxnnUhVW5zozaUKk6Pn1tgs Sep 23 15:27:59.970796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Id: None Sep 23 15:27:59.970796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Name: None Sep 23 15:27:59.970796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Identity-Status: Confirmed Sep 23 15:27:59.970796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Is-Admin-Project: True Sep 23 15:27:59.970796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Id: default Sep 23 15:27:59.970796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Name: Default Sep 23 15:27:59.970796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Id: 7c95b871ff2b4ed89195a9c0fa94e8b4 Sep 23 15:27:59.970796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Name: tempest-TestShelveInstance-1038931392 Sep 23 15:27:59.970796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Role: reader,member Sep 23 15:27:59.970796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Roles: reader,member Sep 23 15:27:59.973008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/7c95b871ff2b4ed89195a9c0fa94e8b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/7c95b871ff2b4ed89195a9c0fa94e8b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_7c95b871ff2b4ed89195a9c0fa94e8b4", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/7c95b871ff2b4ed89195a9c0fa94e8b4"}]}] Sep 23 15:27:59.973008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant: tempest-TestShelveInstance-1038931392 Sep 23 15:27:59.973008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Id: 7c95b871ff2b4ed89195a9c0fa94e8b4 Sep 23 15:27:59.973008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Name: tempest-TestShelveInstance-1038931392 Sep 23 15:27:59.973008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User: tempest-TestShelveInstance-1038931392-project Sep 23 15:27:59.973008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Id: default Sep 23 15:27:59.973008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Name: Default Sep 23 15:27:59.973008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Id: 4bdaecd5dd5d461383878c4b96ef98be Sep 23 15:27:59.973008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Name: tempest-TestShelveInstance-1038931392-project Sep 23 15:27:59.973008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: method: > Sep 23 15:27:59.973008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: exception: Instance 74b48a2a-0dde-4289-b8d6-788a66dafddb could not be found. Sep 23 15:27:59.973008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: action_args: {'id': '74b48a2a-0dde-4289-b8d6-788a66dafddb'} Sep 23 15:27:59.974004 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:27:59.974004 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:27:59.974004 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:27:59.974004 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:27:59.974004 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:27:59.974004 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:27:59.974004 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:27:59.974004 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:27:59.974004 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:27:59.974004 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:27:59.974004 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74b48a2a-0dde-4289-b8d6-788a66dafddb could not be found. Sep 23 15:27:59.974004 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:27:59.974004 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:27:59.974004 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:27:59.974004 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:27:59.974004 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:27:59.974004 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:27:59.974004 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:27:59.974004 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:27:59.974004 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:27:59.975257 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:27:59.975257 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:27:59.975257 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:27:59.975257 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:27:59.975257 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:27:59.975257 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:27:59.975257 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:27:59.975257 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74b48a2a-0dde-4289-b8d6-788a66dafddb could not be found. Sep 23 15:27:59.975257 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:27:59.975257 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:27:59.975257 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:27:59.975257 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:27:59.975257 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:27:59.975257 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:27:59.975257 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:27:59.975257 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:27:59.975257 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74b48a2a-0dde-4289-b8d6-788a66dafddb could not be found. Sep 23 15:27:59.975257 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:27:59.976536 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-054d28b1-428a-4951-af7e-729b8855e5b4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Returning 404 to user: Instance 74b48a2a-0dde-4289-b8d6-788a66dafddb could not be found. {{(pid=121448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:27:59.976536 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-054d28b1-428a-4951-af7e-729b8855e5b4 tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb" status: 404 len: 111 microversion: 2.1 time: 0.034525 Sep 23 15:27:59.976536 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 454/907] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:59 2022] GET /compute/v2.1/servers/74b48a2a-0dde-4289-b8d6-788a66dafddb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:28:00.342299 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a71aee93-02c9-48d8-8242-92fac6fce3ae tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] Calling method '.version_select at 0x7f82dbb27280>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:00.434026 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-a71aee93-02c9-48d8-8242-92fac6fce3ae tempest-TestShelveInstance-1038931392 tempest-TestShelveInstance-1038931392-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2003426208" status: 202 len: 0 microversion: 2.1 time: 0.097624 Sep 23 15:28:00.434643 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 454/908] 10.222.0.55 () {58 vars in 1254 bytes} [Fri Sep 23 15:28:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2003426208 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:28:01.558185 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-5a2575a9-ecee-47f3-85e6-b9ea33c94024 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:01.562256 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-5a2575a9-ecee-47f3-85e6-b9ea33c94024 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:01.565230 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5a2575a9-ecee-47f3-85e6-b9ea33c94024 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:01.565715 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5a2575a9-ecee-47f3-85e6-b9ea33c94024 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:01.566151 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5a2575a9-ecee-47f3-85e6-b9ea33c94024 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:01.566839 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5a2575a9-ecee-47f3-85e6-b9ea33c94024 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:01.567295 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5a2575a9-ecee-47f3-85e6-b9ea33c94024 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:01.567714 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5a2575a9-ecee-47f3-85e6-b9ea33c94024 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:01.581408 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.wsgi [None req-5a2575a9-ecee-47f3-85e6-b9ea33c94024 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] HTTP exception thrown: Instance 46eb43e1-8a8e-4c5e-a071-ef900f024b55 could not be found. Sep 23 15:28:01.583008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-5a2575a9-ecee-47f3-85e6-b9ea33c94024 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Request method failure captured: Sep 23 15:28:01.583008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: request: DELETE /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 HTTP/1.1 Sep 23 15:28:01.583008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept: application/json Sep 23 15:28:01.583008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept-Encoding: identity Sep 23 15:28:01.583008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Connection: close Sep 23 15:28:01.583008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Length: 0 Sep 23 15:28:01.583008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Type: application/json Sep 23 15:28:01.583008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Host: 10.222.0.55 Sep 23 15:28:01.583008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Openstack-System-Scope: None Sep 23 15:28:01.583008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: User-Agent: python-urllib3/1.26.12 Sep 23 15:28:01.583008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Auth-Token: gAAAAABjLc6z5kX1NEdHC6q7BE3PXHLC5hIbEvdxDuXJ-X67qALlq5AFtNCX-mZWdpg8QXGj5SSi_JNV7yaeFmAAigIOxU2VVo0zoWq9DJ2abmiYqd5JEynIIq4T4UokqINUY0YwH-DT_W-iv8-833WO-050zX4ajLVUGKHy5mpN7dgy9E-DAaY Sep 23 15:28:01.583008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Id: None Sep 23 15:28:01.583008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Name: None Sep 23 15:28:01.583008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Identity-Status: Confirmed Sep 23 15:28:01.583008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Is-Admin-Project: True Sep 23 15:28:01.583008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 15:28:01.583008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Id: default Sep 23 15:28:01.583008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Name: Default Sep 23 15:28:01.583008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Id: 1679242155f94d48871525425f74d1c3 Sep 23 15:28:01.583008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-731499941 Sep 23 15:28:01.583008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Role: reader,member Sep 23 15:28:01.583008 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Roles: reader,member Sep 23 15:28:01.584932 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1679242155f94d48871525425f74d1c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1679242155f94d48871525425f74d1c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1679242155f94d48871525425f74d1c3", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1679242155f94d48871525425f74d1c3"}]}] Sep 23 15:28:01.584932 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant: tempest-AttachVolumeShelveTestJSON-731499941 Sep 23 15:28:01.584932 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Id: 1679242155f94d48871525425f74d1c3 Sep 23 15:28:01.584932 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-731499941 Sep 23 15:28:01.584932 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User: tempest-AttachVolumeShelveTestJSON-731499941-project Sep 23 15:28:01.584932 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Id: default Sep 23 15:28:01.584932 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Name: Default Sep 23 15:28:01.584932 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Id: 42dc378333ae4bbdbd42ce041ba15d3f Sep 23 15:28:01.584932 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Name: tempest-AttachVolumeShelveTestJSON-731499941-project Sep 23 15:28:01.584932 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: method: > Sep 23 15:28:01.584932 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: exception: Instance 46eb43e1-8a8e-4c5e-a071-ef900f024b55 could not be found. Sep 23 15:28:01.584932 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: action_args: {'id': '46eb43e1-8a8e-4c5e-a071-ef900f024b55'} Sep 23 15:28:01.586271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:28:01.586271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:01.586271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:28:01.586271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:28:01.586271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:28:01.586271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:28:01.586271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:28:01.586271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:28:01.586271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:28:01.586271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:28:01.586271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46eb43e1-8a8e-4c5e-a071-ef900f024b55 could not be found. Sep 23 15:28:01.586271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:28:01.586271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:28:01.586271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:28:01.586271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:01.586271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:28:01.586271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:28:01.586271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:28:01.586271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:28:01.586271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:28:01.588446 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:28:01.588446 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 15:28:01.588446 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 15:28:01.588446 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 15:28:01.588446 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 15:28:01.588446 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:28:01.588446 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:28:01.588446 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:28:01.588446 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:28:01.588446 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46eb43e1-8a8e-4c5e-a071-ef900f024b55 could not be found. Sep 23 15:28:01.588446 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:28:01.588446 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:28:01.588446 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:28:01.588446 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:01.588446 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:28:01.588446 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:28:01.588446 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:28:01.588446 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:28:01.588446 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46eb43e1-8a8e-4c5e-a071-ef900f024b55 could not be found. Sep 23 15:28:01.588446 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:28:01.589994 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-5a2575a9-ecee-47f3-85e6-b9ea33c94024 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Returning 404 to user: Instance 46eb43e1-8a8e-4c5e-a071-ef900f024b55 could not be found. {{(pid=121448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:28:01.589994 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-5a2575a9-ecee-47f3-85e6-b9ea33c94024 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "DELETE /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 404 len: 111 microversion: 2.20 time: 0.030283 Sep 23 15:28:01.589994 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 455/909] 10.222.0.55 () {60 vars in 1280 bytes} [Fri Sep 23 15:28:01 2022] DELETE /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 15:28:01.596294 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-ec346791-d556-4a1e-a9cb-3a60433a8aa1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:01.597027 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-ec346791-d556-4a1e-a9cb-3a60433a8aa1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 46eb43e1-8a8e-4c5e-a071-ef900f024b55] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:01.604243 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ec346791-d556-4a1e-a9cb-3a60433a8aa1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:01.604729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ec346791-d556-4a1e-a9cb-3a60433a8aa1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:01.605193 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ec346791-d556-4a1e-a9cb-3a60433a8aa1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:01.605886 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ec346791-d556-4a1e-a9cb-3a60433a8aa1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:01.606355 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ec346791-d556-4a1e-a9cb-3a60433a8aa1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:01.606776 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ec346791-d556-4a1e-a9cb-3a60433a8aa1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:01.621123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-ec346791-d556-4a1e-a9cb-3a60433a8aa1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] HTTP exception thrown: Instance 46eb43e1-8a8e-4c5e-a071-ef900f024b55 could not be found. Sep 23 15:28:01.622791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-ec346791-d556-4a1e-a9cb-3a60433a8aa1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Request method failure captured: Sep 23 15:28:01.622791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 HTTP/1.1 Sep 23 15:28:01.622791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:28:01.622791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:28:01.622791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:28:01.622791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:28:01.622791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:28:01.622791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:28:01.622791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:28:01.622791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:28:01.622791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLc6z5kX1NEdHC6q7BE3PXHLC5hIbEvdxDuXJ-X67qALlq5AFtNCX-mZWdpg8QXGj5SSi_JNV7yaeFmAAigIOxU2VVo0zoWq9DJ2abmiYqd5JEynIIq4T4UokqINUY0YwH-DT_W-iv8-833WO-050zX4ajLVUGKHy5mpN7dgy9E-DAaY Sep 23 15:28:01.622791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:28:01.622791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:28:01.622791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:28:01.622791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:28:01.622791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 15:28:01.622791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:28:01.622791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:28:01.622791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: 1679242155f94d48871525425f74d1c3 Sep 23 15:28:01.622791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-731499941 Sep 23 15:28:01.622791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:28:01.622791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:28:01.631817 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1679242155f94d48871525425f74d1c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1679242155f94d48871525425f74d1c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1679242155f94d48871525425f74d1c3", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1679242155f94d48871525425f74d1c3"}]}] Sep 23 15:28:01.631817 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-AttachVolumeShelveTestJSON-731499941 Sep 23 15:28:01.631817 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: 1679242155f94d48871525425f74d1c3 Sep 23 15:28:01.631817 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-731499941 Sep 23 15:28:01.631817 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-AttachVolumeShelveTestJSON-731499941-project Sep 23 15:28:01.631817 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:28:01.631817 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:28:01.631817 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 42dc378333ae4bbdbd42ce041ba15d3f Sep 23 15:28:01.631817 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-AttachVolumeShelveTestJSON-731499941-project Sep 23 15:28:01.631817 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:28:01.631817 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance 46eb43e1-8a8e-4c5e-a071-ef900f024b55 could not be found. Sep 23 15:28:01.631817 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '46eb43e1-8a8e-4c5e-a071-ef900f024b55'} Sep 23 15:28:01.633199 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:28:01.633199 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:01.633199 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:28:01.633199 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:28:01.633199 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:28:01.633199 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:28:01.633199 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:28:01.633199 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:28:01.633199 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:28:01.633199 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:28:01.633199 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46eb43e1-8a8e-4c5e-a071-ef900f024b55 could not be found. Sep 23 15:28:01.633199 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:28:01.633199 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:28:01.633199 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:28:01.633199 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:01.633199 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:28:01.633199 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:28:01.633199 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:28:01.633199 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:28:01.633199 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:28:01.634715 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:28:01.634715 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:28:01.634715 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:28:01.634715 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:28:01.634715 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:28:01.634715 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:28:01.634715 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:28:01.634715 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46eb43e1-8a8e-4c5e-a071-ef900f024b55 could not be found. Sep 23 15:28:01.634715 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:28:01.634715 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:28:01.634715 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:28:01.634715 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:01.634715 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:28:01.634715 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:28:01.634715 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:28:01.634715 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:28:01.634715 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46eb43e1-8a8e-4c5e-a071-ef900f024b55 could not be found. Sep 23 15:28:01.634715 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:28:01.637337 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-ec346791-d556-4a1e-a9cb-3a60433a8aa1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Returning 404 to user: Instance 46eb43e1-8a8e-4c5e-a071-ef900f024b55 could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:28:01.637337 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-ec346791-d556-4a1e-a9cb-3a60433a8aa1 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55" status: 404 len: 111 microversion: 2.20 time: 0.032830 Sep 23 15:28:01.637337 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 455/910] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:28:01 2022] GET /compute/v2.1/servers/46eb43e1-8a8e-4c5e-a071-ef900f024b55 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 15:28:05.100410 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a2f0f825-c458-47ab-985c-8b9b86904845 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:05.101827 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-a2f0f825-c458-47ab-985c-8b9b86904845 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:05.109420 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a2f0f825-c458-47ab-985c-8b9b86904845 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:05.113429 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a2f0f825-c458-47ab-985c-8b9b86904845 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:05.113429 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a2f0f825-c458-47ab-985c-8b9b86904845 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:05.113429 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a2f0f825-c458-47ab-985c-8b9b86904845 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:05.113429 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a2f0f825-c458-47ab-985c-8b9b86904845 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:05.113943 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a2f0f825-c458-47ab-985c-8b9b86904845 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:05.130560 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.wsgi [None req-a2f0f825-c458-47ab-985c-8b9b86904845 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] HTTP exception thrown: Instance 4bba6fdd-bec4-491e-81ba-f3a9863f72ca could not be found. Sep 23 15:28:05.132181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a2f0f825-c458-47ab-985c-8b9b86904845 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Request method failure captured: Sep 23 15:28:05.132181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: request: DELETE /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca HTTP/1.1 Sep 23 15:28:05.132181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept: application/json Sep 23 15:28:05.132181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept-Encoding: identity Sep 23 15:28:05.132181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Connection: close Sep 23 15:28:05.132181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Length: 0 Sep 23 15:28:05.132181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Type: application/json Sep 23 15:28:05.132181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Host: 10.222.0.55 Sep 23 15:28:05.132181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Openstack-System-Scope: None Sep 23 15:28:05.132181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: User-Agent: python-urllib3/1.26.12 Sep 23 15:28:05.132181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Auth-Token: gAAAAABjLc6z5kX1NEdHC6q7BE3PXHLC5hIbEvdxDuXJ-X67qALlq5AFtNCX-mZWdpg8QXGj5SSi_JNV7yaeFmAAigIOxU2VVo0zoWq9DJ2abmiYqd5JEynIIq4T4UokqINUY0YwH-DT_W-iv8-833WO-050zX4ajLVUGKHy5mpN7dgy9E-DAaY Sep 23 15:28:05.132181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Id: None Sep 23 15:28:05.132181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Name: None Sep 23 15:28:05.132181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Identity-Status: Confirmed Sep 23 15:28:05.132181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Is-Admin-Project: True Sep 23 15:28:05.132181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 15:28:05.132181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Id: default Sep 23 15:28:05.132181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Name: Default Sep 23 15:28:05.132181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Id: 1679242155f94d48871525425f74d1c3 Sep 23 15:28:05.132181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-731499941 Sep 23 15:28:05.132181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Role: reader,member Sep 23 15:28:05.132181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Roles: reader,member Sep 23 15:28:05.133837 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1679242155f94d48871525425f74d1c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1679242155f94d48871525425f74d1c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1679242155f94d48871525425f74d1c3", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1679242155f94d48871525425f74d1c3"}]}] Sep 23 15:28:05.133837 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant: tempest-AttachVolumeShelveTestJSON-731499941 Sep 23 15:28:05.133837 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Id: 1679242155f94d48871525425f74d1c3 Sep 23 15:28:05.133837 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-731499941 Sep 23 15:28:05.133837 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User: tempest-AttachVolumeShelveTestJSON-731499941-project Sep 23 15:28:05.133837 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Id: default Sep 23 15:28:05.133837 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Name: Default Sep 23 15:28:05.133837 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Id: 42dc378333ae4bbdbd42ce041ba15d3f Sep 23 15:28:05.133837 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Name: tempest-AttachVolumeShelveTestJSON-731499941-project Sep 23 15:28:05.133837 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: method: > Sep 23 15:28:05.133837 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: exception: Instance 4bba6fdd-bec4-491e-81ba-f3a9863f72ca could not be found. Sep 23 15:28:05.133837 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: action_args: {'id': '4bba6fdd-bec4-491e-81ba-f3a9863f72ca'} Sep 23 15:28:05.135294 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:28:05.135294 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:05.135294 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:28:05.135294 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:28:05.135294 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:28:05.135294 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:28:05.135294 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:28:05.135294 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:28:05.135294 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:28:05.135294 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:28:05.135294 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bba6fdd-bec4-491e-81ba-f3a9863f72ca could not be found. Sep 23 15:28:05.135294 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:28:05.135294 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:28:05.135294 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:28:05.135294 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:05.135294 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:28:05.135294 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:28:05.135294 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:28:05.135294 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:28:05.135294 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:28:05.137711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:28:05.137711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 15:28:05.137711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 15:28:05.137711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 15:28:05.137711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 15:28:05.137711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:28:05.137711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:28:05.137711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:28:05.137711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:28:05.137711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bba6fdd-bec4-491e-81ba-f3a9863f72ca could not be found. Sep 23 15:28:05.137711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:28:05.137711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:28:05.137711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:28:05.137711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:05.137711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:28:05.137711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:28:05.137711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:28:05.137711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:28:05.137711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bba6fdd-bec4-491e-81ba-f3a9863f72ca could not be found. Sep 23 15:28:05.137711 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:28:05.140240 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a2f0f825-c458-47ab-985c-8b9b86904845 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Returning 404 to user: Instance 4bba6fdd-bec4-491e-81ba-f3a9863f72ca could not be found. {{(pid=121448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:28:05.140240 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-a2f0f825-c458-47ab-985c-8b9b86904845 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "DELETE /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 404 len: 111 microversion: 2.20 time: 0.038398 Sep 23 15:28:05.140240 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 456/911] 10.222.0.55 () {60 vars in 1280 bytes} [Fri Sep 23 15:28:05 2022] DELETE /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 15:28:05.143593 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-8c7e5128-0688-4c9d-ab13-886fcbba9c70 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:05.144527 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-8c7e5128-0688-4c9d-ab13-886fcbba9c70 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] [instance: 4bba6fdd-bec4-491e-81ba-f3a9863f72ca] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:05.165863 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c7e5128-0688-4c9d-ab13-886fcbba9c70 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:05.165863 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c7e5128-0688-4c9d-ab13-886fcbba9c70 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:05.165863 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c7e5128-0688-4c9d-ab13-886fcbba9c70 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:05.165863 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c7e5128-0688-4c9d-ab13-886fcbba9c70 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:05.166713 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c7e5128-0688-4c9d-ab13-886fcbba9c70 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:05.166713 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c7e5128-0688-4c9d-ab13-886fcbba9c70 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:05.178697 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-8c7e5128-0688-4c9d-ab13-886fcbba9c70 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] HTTP exception thrown: Instance 4bba6fdd-bec4-491e-81ba-f3a9863f72ca could not be found. Sep 23 15:28:05.180440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-8c7e5128-0688-4c9d-ab13-886fcbba9c70 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Request method failure captured: Sep 23 15:28:05.180440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca HTTP/1.1 Sep 23 15:28:05.180440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:28:05.180440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:28:05.180440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:28:05.180440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:28:05.180440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:28:05.180440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:28:05.180440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:28:05.180440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:28:05.180440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLc6z5kX1NEdHC6q7BE3PXHLC5hIbEvdxDuXJ-X67qALlq5AFtNCX-mZWdpg8QXGj5SSi_JNV7yaeFmAAigIOxU2VVo0zoWq9DJ2abmiYqd5JEynIIq4T4UokqINUY0YwH-DT_W-iv8-833WO-050zX4ajLVUGKHy5mpN7dgy9E-DAaY Sep 23 15:28:05.180440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:28:05.180440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:28:05.180440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:28:05.180440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:28:05.180440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 15:28:05.180440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:28:05.180440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:28:05.180440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: 1679242155f94d48871525425f74d1c3 Sep 23 15:28:05.180440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-731499941 Sep 23 15:28:05.180440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:28:05.180440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:28:05.183076 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1679242155f94d48871525425f74d1c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1679242155f94d48871525425f74d1c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1679242155f94d48871525425f74d1c3", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1679242155f94d48871525425f74d1c3"}]}] Sep 23 15:28:05.183076 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-AttachVolumeShelveTestJSON-731499941 Sep 23 15:28:05.183076 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: 1679242155f94d48871525425f74d1c3 Sep 23 15:28:05.183076 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-731499941 Sep 23 15:28:05.183076 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-AttachVolumeShelveTestJSON-731499941-project Sep 23 15:28:05.183076 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:28:05.183076 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:28:05.183076 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 42dc378333ae4bbdbd42ce041ba15d3f Sep 23 15:28:05.183076 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-AttachVolumeShelveTestJSON-731499941-project Sep 23 15:28:05.183076 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:28:05.183076 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance 4bba6fdd-bec4-491e-81ba-f3a9863f72ca could not be found. Sep 23 15:28:05.183076 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '4bba6fdd-bec4-491e-81ba-f3a9863f72ca'} Sep 23 15:28:05.184284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:28:05.184284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:05.184284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:28:05.184284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:28:05.184284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:28:05.184284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:28:05.184284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:28:05.184284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:28:05.184284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:28:05.184284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:28:05.184284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bba6fdd-bec4-491e-81ba-f3a9863f72ca could not be found. Sep 23 15:28:05.184284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:28:05.184284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:28:05.184284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:28:05.184284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:05.184284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:28:05.184284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:28:05.184284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:28:05.184284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:28:05.184284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:28:05.185548 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:28:05.185548 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:28:05.185548 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:28:05.185548 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:28:05.185548 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:28:05.185548 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:28:05.185548 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:28:05.185548 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bba6fdd-bec4-491e-81ba-f3a9863f72ca could not be found. Sep 23 15:28:05.185548 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:28:05.185548 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:28:05.185548 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:28:05.185548 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:05.185548 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:28:05.185548 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:28:05.185548 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:28:05.185548 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:28:05.185548 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bba6fdd-bec4-491e-81ba-f3a9863f72ca could not be found. Sep 23 15:28:05.185548 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:28:05.187848 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-8c7e5128-0688-4c9d-ab13-886fcbba9c70 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] Returning 404 to user: Instance 4bba6fdd-bec4-491e-81ba-f3a9863f72ca could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:28:05.187848 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-8c7e5128-0688-4c9d-ab13-886fcbba9c70 tempest-AttachVolumeShelveTestJSON-731499941 tempest-AttachVolumeShelveTestJSON-731499941-project] 10.222.0.55 "GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca" status: 404 len: 111 microversion: 2.20 time: 0.043197 Sep 23 15:28:05.187848 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 456/912] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Sep 23 15:28:05 2022] GET /compute/v2.1/servers/4bba6fdd-bec4-491e-81ba-f3a9863f72ca => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 15:28:19.600605 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:28:19.601480 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:28:19.767017 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-764a1baf-1672-4727-805f-08008032ec37 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Action: 'create', calling method: .version_select at 0x7f82db9424c0>, body: {"keypair": {"name": "tempest-keypair-791437157", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLCdyo2pu2j9zLKgB1xWzPrS2YFOAPh+40Obxic5Do5sxEvJ8L+lTLXeRuj1n2hCHBeXh/L/QNxrbxYoAC5GJ/rK3s97rfDOyykrmxmADsQxf3bikPCIBbYF5zTZqNDNw=="}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:28:19.792127 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-764a1baf-1672-4727-805f-08008032ec37 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Getting quotas for project 695b6a2a390b481bbca2fd367273c268. Resources: {'key_pairs'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:28:19.792127 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-764a1baf-1672-4727-805f-08008032ec37 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Getting quotas for user 97e06913feae4c23a9abbcd508f818d3 and project 695b6a2a390b481bbca2fd367273c268. Resources: {'key_pairs'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:28:19.938869 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-764a1baf-1672-4727-805f-08008032ec37 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.343359 Sep 23 15:28:19.961603 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 457/913] 10.222.0.55 () {60 vars in 1159 bytes} [Fri Sep 23 15:28:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:28:23.146810 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-e57f5cf0-1477-4754-994d-6cdb53d0a143 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-865357226", "imageRef": "051c4746-7f50-4edb-b09d-a8935df360de", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8efafa58-1ac7-4f82-bc57-6974c89b4f6e"}], "security_groups": [{"name": "tempest-securitygroup--335260707"}], "key_name": "tempest-keypair-791437157", "user_data": "}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:28:23.167121 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:28:23.167121 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:28:23.309500 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.network.neutron [None req-e57f5cf0-1477-4754-994d-6cdb53d0a143 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] validate_networks() for [('8efafa58-1ac7-4f82-bc57-6974c89b4f6e', None, None, None, None, None)] {{(pid=121450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:28:23.764072 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-e57f5cf0-1477-4754-994d-6cdb53d0a143 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Flavor limits 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:28:23.764806 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-e57f5cf0-1477-4754-994d-6cdb53d0a143 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Image limits 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:28:23.765632 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-e57f5cf0-1477-4754-994d-6cdb53d0a143 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Flavor pref 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:28:23.766610 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-e57f5cf0-1477-4754-994d-6cdb53d0a143 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Image pref 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:28:23.767329 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-e57f5cf0-1477-4754-994d-6cdb53d0a143 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:28:23.779494 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e57f5cf0-1477-4754-994d-6cdb53d0a143 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:23.780008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e57f5cf0-1477-4754-994d-6cdb53d0a143 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:23.780494 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e57f5cf0-1477-4754-994d-6cdb53d0a143 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:23.781227 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e57f5cf0-1477-4754-994d-6cdb53d0a143 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:23.781689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e57f5cf0-1477-4754-994d-6cdb53d0a143 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:23.782109 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e57f5cf0-1477-4754-994d-6cdb53d0a143 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:23.802120 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-e57f5cf0-1477-4754-994d-6cdb53d0a143 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Getting quotas for project 695b6a2a390b481bbca2fd367273c268. Resources: {'ram', 'instances', 'cores'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:28:23.817470 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-e57f5cf0-1477-4754-994d-6cdb53d0a143 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Getting quotas for user 97e06913feae4c23a9abbcd508f818d3 and project 695b6a2a390b481bbca2fd367273c268. Resources: {'ram', 'instances', 'cores'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:28:23.832736 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-e57f5cf0-1477-4754-994d-6cdb53d0a143 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Going to run 1 instances... {{(pid=121450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:28:23.835081 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-e57f5cf0-1477-4754-994d-6cdb53d0a143 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='051c4746-7f50-4edb-b09d-a8935df360de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:28:23.991230 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-e57f5cf0-1477-4754-994d-6cdb53d0a143 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.849062 Sep 23 15:28:23.992109 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 457/914] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Sep 23 15:28:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:28:24.004716 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-4c4f66be-479c-4494-8c50-dde10c9c9a5d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:24.005356 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-4c4f66be-479c-4494-8c50-dde10c9c9a5d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:24.066031 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-4c4f66be-479c-4494-8c50-dde10c9c9a5d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:24.073815 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-4c4f66be-479c-4494-8c50-dde10c9c9a5d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0" status: 200 len: 1240 microversion: 2.1 time: 0.073786 Sep 23 15:28:24.074469 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 458/915] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:23 2022] GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 => generated 1240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:25.097189 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-0bb01af8-555f-4bdd-86a3-1e77173722ce tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:25.097832 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-0bb01af8-555f-4bdd-86a3-1e77173722ce tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:25.182155 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-0bb01af8-555f-4bdd-86a3-1e77173722ce tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:25.192205 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-0bb01af8-555f-4bdd-86a3-1e77173722ce tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0" status: 200 len: 1240 microversion: 2.1 time: 0.098860 Sep 23 15:28:25.192841 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 458/916] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:25 2022] GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 => generated 1240 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:26.217355 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-41b9ab12-cbe9-46a0-9245-15a4112a738e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:26.217930 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-41b9ab12-cbe9-46a0-9245-15a4112a738e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:26.224556 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-41b9ab12-cbe9-46a0-9245-15a4112a738e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:26.225035 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-41b9ab12-cbe9-46a0-9245-15a4112a738e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:26.225467 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-41b9ab12-cbe9-46a0-9245-15a4112a738e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:26.226166 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-41b9ab12-cbe9-46a0-9245-15a4112a738e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:26.226617 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-41b9ab12-cbe9-46a0-9245-15a4112a738e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:26.227075 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-41b9ab12-cbe9-46a0-9245-15a4112a738e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:26.291806 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-41b9ab12-cbe9-46a0-9245-15a4112a738e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:26.300014 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-41b9ab12-cbe9-46a0-9245-15a4112a738e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0" status: 200 len: 1292 microversion: 2.1 time: 0.086978 Sep 23 15:28:26.300788 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 459/917] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:26 2022] GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 => generated 1292 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:27.327997 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-66dfeaff-b6dc-4ad2-9bd9-0eb64a4736c7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:27.329531 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-66dfeaff-b6dc-4ad2-9bd9-0eb64a4736c7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:27.343926 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-66dfeaff-b6dc-4ad2-9bd9-0eb64a4736c7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:27.343926 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-66dfeaff-b6dc-4ad2-9bd9-0eb64a4736c7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:27.343926 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-66dfeaff-b6dc-4ad2-9bd9-0eb64a4736c7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:27.343926 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-66dfeaff-b6dc-4ad2-9bd9-0eb64a4736c7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:27.344347 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-66dfeaff-b6dc-4ad2-9bd9-0eb64a4736c7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:27.344347 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-66dfeaff-b6dc-4ad2-9bd9-0eb64a4736c7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:27.412298 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-66dfeaff-b6dc-4ad2-9bd9-0eb64a4736c7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:27.421634 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-66dfeaff-b6dc-4ad2-9bd9-0eb64a4736c7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0" status: 200 len: 1298 microversion: 2.1 time: 0.099196 Sep 23 15:28:27.422221 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 459/918] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:27 2022] GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 => generated 1298 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:28.450041 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-499f41f4-bb28-4952-afb1-92010bd9dd48 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:28.450664 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-499f41f4-bb28-4952-afb1-92010bd9dd48 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:28.457721 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-499f41f4-bb28-4952-afb1-92010bd9dd48 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:28.458273 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-499f41f4-bb28-4952-afb1-92010bd9dd48 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:28.458660 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-499f41f4-bb28-4952-afb1-92010bd9dd48 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:28.459380 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-499f41f4-bb28-4952-afb1-92010bd9dd48 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:28.459870 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-499f41f4-bb28-4952-afb1-92010bd9dd48 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:28.460332 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-499f41f4-bb28-4952-afb1-92010bd9dd48 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:28.602445 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-499f41f4-bb28-4952-afb1-92010bd9dd48 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:28.611123 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-499f41f4-bb28-4952-afb1-92010bd9dd48 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0" status: 200 len: 1365 microversion: 2.1 time: 0.165926 Sep 23 15:28:28.612156 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 460/919] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:28 2022] GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:28.896563 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-6cdfa6af-1090-42ad-b932-46264b9929eb req-e096c69f-c59f-4b99-8a3b-23d642ecdb93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0", "tag": "69f1e0fd-61ab-460b-ba4e-c5d2bd2846d6"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:28:28.910479 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-6cdfa6af-1090-42ad-b932-46264b9929eb req-e096c69f-c59f-4b99-8a3b-23d642ecdb93 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:28.912147 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-6cdfa6af-1090-42ad-b932-46264b9929eb req-e096c69f-c59f-4b99-8a3b-23d642ecdb93 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:28.912682 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-6cdfa6af-1090-42ad-b932-46264b9929eb req-e096c69f-c59f-4b99-8a3b-23d642ecdb93 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:28.942463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-6cdfa6af-1090-42ad-b932-46264b9929eb req-e096c69f-c59f-4b99-8a3b-23d642ecdb93 service nova] Creating event network-changed:69f1e0fd-61ab-460b-ba4e-c5d2bd2846d6 for instance 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 on hv-cinder-85530 Sep 23 15:28:28.948895 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-6cdfa6af-1090-42ad-b932-46264b9929eb req-e096c69f-c59f-4b99-8a3b-23d642ecdb93 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056961 Sep 23 15:28:28.950523 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 460/920] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:28:29.642775 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-6d9b4cf2-6f25-4a7d-91e3-a772e1398860 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:29.643518 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-6d9b4cf2-6f25-4a7d-91e3-a772e1398860 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:29.651195 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6d9b4cf2-6f25-4a7d-91e3-a772e1398860 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:29.651830 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6d9b4cf2-6f25-4a7d-91e3-a772e1398860 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:29.652710 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6d9b4cf2-6f25-4a7d-91e3-a772e1398860 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:29.653230 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6d9b4cf2-6f25-4a7d-91e3-a772e1398860 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:29.653766 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6d9b4cf2-6f25-4a7d-91e3-a772e1398860 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:29.654271 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-6d9b4cf2-6f25-4a7d-91e3-a772e1398860 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:29.804714 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-6d9b4cf2-6f25-4a7d-91e3-a772e1398860 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:29.813752 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-6d9b4cf2-6f25-4a7d-91e3-a772e1398860 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0" status: 200 len: 1365 microversion: 2.1 time: 0.176380 Sep 23 15:28:29.814363 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 461/921] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:29 2022] GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:30.840828 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-3b488483-3fd1-4a1b-903e-0f94e2cad302 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:30.841629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-3b488483-3fd1-4a1b-903e-0f94e2cad302 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:30.850053 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3b488483-3fd1-4a1b-903e-0f94e2cad302 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:30.850586 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3b488483-3fd1-4a1b-903e-0f94e2cad302 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:30.851155 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3b488483-3fd1-4a1b-903e-0f94e2cad302 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:30.853441 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3b488483-3fd1-4a1b-903e-0f94e2cad302 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:30.853877 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3b488483-3fd1-4a1b-903e-0f94e2cad302 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:30.854384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3b488483-3fd1-4a1b-903e-0f94e2cad302 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:31.005273 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-3b488483-3fd1-4a1b-903e-0f94e2cad302 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:31.014503 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-3b488483-3fd1-4a1b-903e-0f94e2cad302 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0" status: 200 len: 1365 microversion: 2.1 time: 0.179665 Sep 23 15:28:31.015080 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 461/922] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:30 2022] GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:28:31.190246 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-72c75e3f-bcdf-4ace-a24c-a906846fd97c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1815844192", "imageRef": "051c4746-7f50-4edb-b09d-a8935df360de", "flavorRef": "452", "networks": [{"uuid": "92097787-289b-4a33-8ae1-9d8232d75ce8"}]}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:28:31.252587 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.network.neutron [None req-72c75e3f-bcdf-4ace-a24c-a906846fd97c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] validate_networks() for [('92097787-289b-4a33-8ae1-9d8232d75ce8', None, None, None, None, None)] {{(pid=121448) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:28:31.630654 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-72c75e3f-bcdf-4ace-a24c-a906846fd97c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Flavor limits 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:28:31.631450 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-72c75e3f-bcdf-4ace-a24c-a906846fd97c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Image limits 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:28:31.632387 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-72c75e3f-bcdf-4ace-a24c-a906846fd97c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Flavor pref 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:28:31.633730 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-72c75e3f-bcdf-4ace-a24c-a906846fd97c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Image pref 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:28:31.634487 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-72c75e3f-bcdf-4ace-a24c-a906846fd97c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:28:31.643648 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-72c75e3f-bcdf-4ace-a24c-a906846fd97c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:31.644181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-72c75e3f-bcdf-4ace-a24c-a906846fd97c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:31.644627 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-72c75e3f-bcdf-4ace-a24c-a906846fd97c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:31.645374 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-72c75e3f-bcdf-4ace-a24c-a906846fd97c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:31.645836 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-72c75e3f-bcdf-4ace-a24c-a906846fd97c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:31.646265 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-72c75e3f-bcdf-4ace-a24c-a906846fd97c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:31.667318 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-72c75e3f-bcdf-4ace-a24c-a906846fd97c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Getting quotas for project 719783ecf917404294351bbb445b9f1b. Resources: {'ram', 'instances', 'cores'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:28:31.671432 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-72c75e3f-bcdf-4ace-a24c-a906846fd97c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Getting quotas for user 78bb70c49abc42cabecb413112fbb31a and project 719783ecf917404294351bbb445b9f1b. Resources: {'ram', 'instances', 'cores'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:28:31.684273 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-72c75e3f-bcdf-4ace-a24c-a906846fd97c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Going to run 1 instances... {{(pid=121448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:28:31.686605 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-72c75e3f-bcdf-4ace-a24c-a906846fd97c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='051c4746-7f50-4edb-b09d-a8935df360de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:28:31.808134 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-72c75e3f-bcdf-4ace-a24c-a906846fd97c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621793 Sep 23 15:28:31.808861 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 462/923] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Sep 23 15:28:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:28:31.820131 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-0a2e553a-e547-49b5-bd5a-83355f2ac050 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:31.820802 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-0a2e553a-e547-49b5-bd5a-83355f2ac050 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:31.880665 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-0a2e553a-e547-49b5-bd5a-83355f2ac050 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:31.886149 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-0a2e553a-e547-49b5-bd5a-83355f2ac050 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d" status: 200 len: 1214 microversion: 2.1 time: 0.069862 Sep 23 15:28:31.886620 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 462/924] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:31 2022] GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:28:32.037912 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-84b858ee-c095-4125-94c0-75c5fe3fa49e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:32.038535 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-84b858ee-c095-4125-94c0-75c5fe3fa49e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:32.048042 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-84b858ee-c095-4125-94c0-75c5fe3fa49e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:32.048543 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-84b858ee-c095-4125-94c0-75c5fe3fa49e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:32.048991 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-84b858ee-c095-4125-94c0-75c5fe3fa49e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:32.049699 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-84b858ee-c095-4125-94c0-75c5fe3fa49e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:32.050162 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-84b858ee-c095-4125-94c0-75c5fe3fa49e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:32.050595 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-84b858ee-c095-4125-94c0-75c5fe3fa49e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:32.196360 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-84b858ee-c095-4125-94c0-75c5fe3fa49e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:32.204114 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-84b858ee-c095-4125-94c0-75c5fe3fa49e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0" status: 200 len: 1365 microversion: 2.1 time: 0.170061 Sep 23 15:28:32.208017 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 463/925] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:32 2022] GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:32.909025 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-86693965-034f-4f5b-96ae-4fd024c881ce tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:32.909624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-86693965-034f-4f5b-96ae-4fd024c881ce tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:32.917076 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-86693965-034f-4f5b-96ae-4fd024c881ce tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:32.917560 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-86693965-034f-4f5b-96ae-4fd024c881ce tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:32.917999 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-86693965-034f-4f5b-96ae-4fd024c881ce tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:32.918693 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-86693965-034f-4f5b-96ae-4fd024c881ce tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:32.919138 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-86693965-034f-4f5b-96ae-4fd024c881ce tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:32.919556 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-86693965-034f-4f5b-96ae-4fd024c881ce tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:32.981371 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-86693965-034f-4f5b-96ae-4fd024c881ce tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:32.989240 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-86693965-034f-4f5b-96ae-4fd024c881ce tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d" status: 200 len: 1218 microversion: 2.1 time: 0.083923 Sep 23 15:28:32.989781 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 463/926] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:32 2022] GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:33.227566 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a09a34c6-97cf-473f-a96c-e8cd9ae16686 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:33.228207 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-a09a34c6-97cf-473f-a96c-e8cd9ae16686 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:33.234758 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a09a34c6-97cf-473f-a96c-e8cd9ae16686 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:33.237123 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a09a34c6-97cf-473f-a96c-e8cd9ae16686 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:33.237123 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a09a34c6-97cf-473f-a96c-e8cd9ae16686 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:33.237123 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a09a34c6-97cf-473f-a96c-e8cd9ae16686 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:33.237123 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a09a34c6-97cf-473f-a96c-e8cd9ae16686 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:33.237483 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a09a34c6-97cf-473f-a96c-e8cd9ae16686 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:33.374895 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a09a34c6-97cf-473f-a96c-e8cd9ae16686 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:33.382659 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-a09a34c6-97cf-473f-a96c-e8cd9ae16686 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0" status: 200 len: 1365 microversion: 2.1 time: 0.159610 Sep 23 15:28:33.383263 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 464/927] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:33 2022] GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:33.835359 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-3f64b50e-0972-4600-bec3-418823f45518 req-5d4d1fac-0788-4f99-8919-eacaddf3a394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0", "name": "network-vif-plugged", "status": "completed", "tag": "69f1e0fd-61ab-460b-ba4e-c5d2bd2846d6"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:28:33.841374 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell0:SELECT=2 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:28:33.847089 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-3f64b50e-0972-4600-bec3-418823f45518 req-5d4d1fac-0788-4f99-8919-eacaddf3a394 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:33.851559 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-3f64b50e-0972-4600-bec3-418823f45518 req-5d4d1fac-0788-4f99-8919-eacaddf3a394 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:33.851559 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-3f64b50e-0972-4600-bec3-418823f45518 req-5d4d1fac-0788-4f99-8919-eacaddf3a394 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:33.860543 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-3f64b50e-0972-4600-bec3-418823f45518 req-5d4d1fac-0788-4f99-8919-eacaddf3a394 service nova] Creating event network-vif-plugged:69f1e0fd-61ab-460b-ba4e-c5d2bd2846d6 for instance 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 on hv-cinder-85530 Sep 23 15:28:33.865638 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-3f64b50e-0972-4600-bec3-418823f45518 req-5d4d1fac-0788-4f99-8919-eacaddf3a394 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034030 Sep 23 15:28:33.866250 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 464/928] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:28:34.014370 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-240b7b2a-5934-4863-beea-e9e69d65a013 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:34.015106 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-240b7b2a-5934-4863-beea-e9e69d65a013 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:34.022391 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-240b7b2a-5934-4863-beea-e9e69d65a013 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:34.022905 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-240b7b2a-5934-4863-beea-e9e69d65a013 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:34.023436 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-240b7b2a-5934-4863-beea-e9e69d65a013 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:34.025174 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-240b7b2a-5934-4863-beea-e9e69d65a013 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:34.025785 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-240b7b2a-5934-4863-beea-e9e69d65a013 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:34.026307 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-240b7b2a-5934-4863-beea-e9e69d65a013 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:34.101604 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-240b7b2a-5934-4863-beea-e9e69d65a013 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:34.110014 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-240b7b2a-5934-4863-beea-e9e69d65a013 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d" status: 200 len: 1274 microversion: 2.1 time: 0.100024 Sep 23 15:28:34.110605 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 465/929] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:34 2022] GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d => generated 1274 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:34.409617 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-38ae7a9c-eb2d-4d46-8f63-cbe1241a9dea tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:34.411051 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-38ae7a9c-eb2d-4d46-8f63-cbe1241a9dea tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:34.418105 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-38ae7a9c-eb2d-4d46-8f63-cbe1241a9dea tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:34.418726 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-38ae7a9c-eb2d-4d46-8f63-cbe1241a9dea tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:34.419261 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-38ae7a9c-eb2d-4d46-8f63-cbe1241a9dea tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:34.420095 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-38ae7a9c-eb2d-4d46-8f63-cbe1241a9dea tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:34.420675 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-38ae7a9c-eb2d-4d46-8f63-cbe1241a9dea tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:34.421201 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-38ae7a9c-eb2d-4d46-8f63-cbe1241a9dea tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:34.665915 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-38ae7a9c-eb2d-4d46-8f63-cbe1241a9dea tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:34.673846 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-38ae7a9c-eb2d-4d46-8f63-cbe1241a9dea tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0" status: 200 len: 1365 microversion: 2.1 time: 0.270530 Sep 23 15:28:34.674473 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 465/930] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:34 2022] GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 => generated 1365 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:35.134346 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-33cfc101-a75e-4c2c-9062-4f272a8c6c4a tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:35.134977 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-33cfc101-a75e-4c2c-9062-4f272a8c6c4a tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:35.141846 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-33cfc101-a75e-4c2c-9062-4f272a8c6c4a tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:35.142345 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-33cfc101-a75e-4c2c-9062-4f272a8c6c4a tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:35.142794 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-33cfc101-a75e-4c2c-9062-4f272a8c6c4a tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:35.143507 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-33cfc101-a75e-4c2c-9062-4f272a8c6c4a tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:35.144010 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-33cfc101-a75e-4c2c-9062-4f272a8c6c4a tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:35.144504 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-33cfc101-a75e-4c2c-9062-4f272a8c6c4a tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:35.290405 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-33cfc101-a75e-4c2c-9062-4f272a8c6c4a tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:35.298794 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-33cfc101-a75e-4c2c-9062-4f272a8c6c4a tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d" status: 200 len: 1314 microversion: 2.1 time: 0.168556 Sep 23 15:28:35.299381 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 466/931] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:35 2022] GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:35.697710 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-391da3c7-3df7-4439-94a8-4279f7169f8f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:35.698434 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-391da3c7-3df7-4439-94a8-4279f7169f8f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:35.706499 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-391da3c7-3df7-4439-94a8-4279f7169f8f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:35.707001 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-391da3c7-3df7-4439-94a8-4279f7169f8f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:35.707451 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-391da3c7-3df7-4439-94a8-4279f7169f8f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:35.708241 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-391da3c7-3df7-4439-94a8-4279f7169f8f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:35.708772 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-391da3c7-3df7-4439-94a8-4279f7169f8f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:35.713146 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-391da3c7-3df7-4439-94a8-4279f7169f8f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:35.952259 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-391da3c7-3df7-4439-94a8-4279f7169f8f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:35.960467 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-391da3c7-3df7-4439-94a8-4279f7169f8f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0" status: 200 len: 1365 microversion: 2.1 time: 0.266640 Sep 23 15:28:35.961293 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 466/932] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:35 2022] GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:36.321335 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-5a1bd7cd-a9ae-4384-8bbd-6368f80e2cf0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:36.321957 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-5a1bd7cd-a9ae-4384-8bbd-6368f80e2cf0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:36.328536 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5a1bd7cd-a9ae-4384-8bbd-6368f80e2cf0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:36.329018 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5a1bd7cd-a9ae-4384-8bbd-6368f80e2cf0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:36.329451 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5a1bd7cd-a9ae-4384-8bbd-6368f80e2cf0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:36.330133 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5a1bd7cd-a9ae-4384-8bbd-6368f80e2cf0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:36.330586 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5a1bd7cd-a9ae-4384-8bbd-6368f80e2cf0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:36.331009 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5a1bd7cd-a9ae-4384-8bbd-6368f80e2cf0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:36.370487 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-c77bad0a-50df-45f1-94c6-f32f1a4849df req-4a00bc06-e754-413b-8e4d-64a0d9e5c48b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e1bef03-6235-4e2e-b446-2c19dd4d2b1d", "tag": "4da16b6c-5b22-4e9b-9b6f-1bc9305a2379"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:28:36.380983 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-c77bad0a-50df-45f1-94c6-f32f1a4849df req-4a00bc06-e754-413b-8e4d-64a0d9e5c48b service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:36.381487 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-c77bad0a-50df-45f1-94c6-f32f1a4849df req-4a00bc06-e754-413b-8e4d-64a0d9e5c48b service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:36.381916 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-c77bad0a-50df-45f1-94c6-f32f1a4849df req-4a00bc06-e754-413b-8e4d-64a0d9e5c48b service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:36.395004 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-c77bad0a-50df-45f1-94c6-f32f1a4849df req-4a00bc06-e754-413b-8e4d-64a0d9e5c48b service nova] Creating event network-changed:4da16b6c-5b22-4e9b-9b6f-1bc9305a2379 for instance 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d on hv-cinder-85530 Sep 23 15:28:36.400668 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-c77bad0a-50df-45f1-94c6-f32f1a4849df req-4a00bc06-e754-413b-8e4d-64a0d9e5c48b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035486 Sep 23 15:28:36.401566 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 467/933] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:28:36.475430 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-5a1bd7cd-a9ae-4384-8bbd-6368f80e2cf0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:36.485625 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-5a1bd7cd-a9ae-4384-8bbd-6368f80e2cf0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d" status: 200 len: 1314 microversion: 2.1 time: 0.168088 Sep 23 15:28:36.486207 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 467/934] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:36 2022] GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:36.983813 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-02653e72-bfc2-4a18-859c-5d388277bb35 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:36.984733 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-02653e72-bfc2-4a18-859c-5d388277bb35 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:36.991857 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-02653e72-bfc2-4a18-859c-5d388277bb35 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:36.992656 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-02653e72-bfc2-4a18-859c-5d388277bb35 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:36.993944 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-02653e72-bfc2-4a18-859c-5d388277bb35 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:36.994887 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-02653e72-bfc2-4a18-859c-5d388277bb35 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:36.995366 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-02653e72-bfc2-4a18-859c-5d388277bb35 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:36.995802 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-02653e72-bfc2-4a18-859c-5d388277bb35 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:37.233517 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-02653e72-bfc2-4a18-859c-5d388277bb35 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:37.241928 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-02653e72-bfc2-4a18-859c-5d388277bb35 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0" status: 200 len: 1554 microversion: 2.1 time: 0.262627 Sep 23 15:28:37.243717 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 468/935] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:36 2022] GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 => generated 1554 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:37.267380 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-5da529d2-14a0-46d1-8508-bade9d0d52be tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:37.267874 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-5da529d2-14a0-46d1-8508-bade9d0d52be tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:37.275326 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5da529d2-14a0-46d1-8508-bade9d0d52be tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:37.275846 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5da529d2-14a0-46d1-8508-bade9d0d52be tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:37.276319 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5da529d2-14a0-46d1-8508-bade9d0d52be tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:37.277028 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5da529d2-14a0-46d1-8508-bade9d0d52be tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:37.277488 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5da529d2-14a0-46d1-8508-bade9d0d52be tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:37.277919 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-5da529d2-14a0-46d1-8508-bade9d0d52be tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:37.361589 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-5da529d2-14a0-46d1-8508-bade9d0d52be tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098213 Sep 23 15:28:37.362188 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 468/936] 10.222.0.55 () {58 vars in 1275 bytes} [Fri Sep 23 15:28:37 2022] GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:28:37.511300 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-79d88d11-6c71-4bcf-a0bf-815cd3ceff45 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:37.512065 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-79d88d11-6c71-4bcf-a0bf-815cd3ceff45 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:37.518692 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-79d88d11-6c71-4bcf-a0bf-815cd3ceff45 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:37.519191 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-79d88d11-6c71-4bcf-a0bf-815cd3ceff45 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:37.519644 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-79d88d11-6c71-4bcf-a0bf-815cd3ceff45 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:37.520393 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-79d88d11-6c71-4bcf-a0bf-815cd3ceff45 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:37.520853 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-79d88d11-6c71-4bcf-a0bf-815cd3ceff45 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:37.521771 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-79d88d11-6c71-4bcf-a0bf-815cd3ceff45 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:37.671822 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-79d88d11-6c71-4bcf-a0bf-815cd3ceff45 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:37.680636 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-79d88d11-6c71-4bcf-a0bf-815cd3ceff45 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d" status: 200 len: 1314 microversion: 2.1 time: 0.173431 Sep 23 15:28:37.690123 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 469/937] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:37 2022] GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:38.663243 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-ee8aacba-93bb-4da5-b301-17660da8f9bd req-8b75e38c-3a65-4843-87ea-f43900455ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0", "tag": "69f1e0fd-61ab-460b-ba4e-c5d2bd2846d6"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:28:38.673298 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-ee8aacba-93bb-4da5-b301-17660da8f9bd req-8b75e38c-3a65-4843-87ea-f43900455ad7 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:38.673781 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-ee8aacba-93bb-4da5-b301-17660da8f9bd req-8b75e38c-3a65-4843-87ea-f43900455ad7 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:38.674213 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-ee8aacba-93bb-4da5-b301-17660da8f9bd req-8b75e38c-3a65-4843-87ea-f43900455ad7 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:38.685656 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-ee8aacba-93bb-4da5-b301-17660da8f9bd req-8b75e38c-3a65-4843-87ea-f43900455ad7 service nova] Creating event network-changed:69f1e0fd-61ab-460b-ba4e-c5d2bd2846d6 for instance 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 on hv-cinder-85530 Sep 23 15:28:38.690885 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-ee8aacba-93bb-4da5-b301-17660da8f9bd req-8b75e38c-3a65-4843-87ea-f43900455ad7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031838 Sep 23 15:28:38.691661 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 469/938] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:28:38.702775 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-6987f09a-515d-4168-a4e9-702231c9b50c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:38.703466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-6987f09a-515d-4168-a4e9-702231c9b50c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:38.710134 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6987f09a-515d-4168-a4e9-702231c9b50c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:38.710717 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6987f09a-515d-4168-a4e9-702231c9b50c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:38.711896 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6987f09a-515d-4168-a4e9-702231c9b50c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:38.712801 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6987f09a-515d-4168-a4e9-702231c9b50c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:38.713325 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6987f09a-515d-4168-a4e9-702231c9b50c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:38.713819 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6987f09a-515d-4168-a4e9-702231c9b50c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:38.923640 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-6987f09a-515d-4168-a4e9-702231c9b50c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:38.933899 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-6987f09a-515d-4168-a4e9-702231c9b50c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d" status: 200 len: 1314 microversion: 2.1 time: 0.234967 Sep 23 15:28:38.934791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 470/939] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:38 2022] GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:39.959693 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-f1b87da3-a0d4-4cd6-8b6a-99421737837e tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:39.960418 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-f1b87da3-a0d4-4cd6-8b6a-99421737837e tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:39.967445 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f1b87da3-a0d4-4cd6-8b6a-99421737837e tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:39.967937 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f1b87da3-a0d4-4cd6-8b6a-99421737837e tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:39.984392 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f1b87da3-a0d4-4cd6-8b6a-99421737837e tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:39.984392 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f1b87da3-a0d4-4cd6-8b6a-99421737837e tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:39.984392 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f1b87da3-a0d4-4cd6-8b6a-99421737837e tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:39.984392 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-f1b87da3-a0d4-4cd6-8b6a-99421737837e tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:40.107355 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-f1b87da3-a0d4-4cd6-8b6a-99421737837e tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:40.115102 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-f1b87da3-a0d4-4cd6-8b6a-99421737837e tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d" status: 200 len: 1314 microversion: 2.1 time: 0.160148 Sep 23 15:28:40.115673 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 470/940] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:39 2022] GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:41.138739 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-6b277423-44b5-4d82-b521-8b33e95812f8 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:41.139350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-6b277423-44b5-4d82-b521-8b33e95812f8 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:41.145850 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6b277423-44b5-4d82-b521-8b33e95812f8 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:41.146335 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6b277423-44b5-4d82-b521-8b33e95812f8 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:41.146767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6b277423-44b5-4d82-b521-8b33e95812f8 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:41.147455 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6b277423-44b5-4d82-b521-8b33e95812f8 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:41.147906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6b277423-44b5-4d82-b521-8b33e95812f8 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:41.148881 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6b277423-44b5-4d82-b521-8b33e95812f8 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:41.286554 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-6b277423-44b5-4d82-b521-8b33e95812f8 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:41.295028 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-6b277423-44b5-4d82-b521-8b33e95812f8 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d" status: 200 len: 1314 microversion: 2.1 time: 0.160144 Sep 23 15:28:41.295617 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 471/941] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:41 2022] GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:42.318405 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-3a8166f1-45d5-40fb-8e04-029eec9a821e tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:42.319019 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-3a8166f1-45d5-40fb-8e04-029eec9a821e tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:42.321559 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell0:SELECT=2 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:28:42.322235 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell0:SELECT=12 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:28:42.326938 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3a8166f1-45d5-40fb-8e04-029eec9a821e tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:42.333927 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3a8166f1-45d5-40fb-8e04-029eec9a821e tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:42.333927 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3a8166f1-45d5-40fb-8e04-029eec9a821e tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:42.333927 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3a8166f1-45d5-40fb-8e04-029eec9a821e tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:42.333927 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3a8166f1-45d5-40fb-8e04-029eec9a821e tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:42.334347 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-3a8166f1-45d5-40fb-8e04-029eec9a821e tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:42.460269 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-3a8166f1-45d5-40fb-8e04-029eec9a821e tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:42.468747 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-3a8166f1-45d5-40fb-8e04-029eec9a821e tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d" status: 200 len: 1314 microversion: 2.1 time: 0.154106 Sep 23 15:28:42.469322 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 471/942] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:42 2022] GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:43.492960 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-f8c4e76f-1b65-4052-90d4-00f227a16262 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:43.493798 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-f8c4e76f-1b65-4052-90d4-00f227a16262 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:43.495772 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell0:SELECT=10 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:28:43.500976 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f8c4e76f-1b65-4052-90d4-00f227a16262 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:43.501467 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f8c4e76f-1b65-4052-90d4-00f227a16262 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:43.501905 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f8c4e76f-1b65-4052-90d4-00f227a16262 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:43.502603 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f8c4e76f-1b65-4052-90d4-00f227a16262 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:43.503062 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f8c4e76f-1b65-4052-90d4-00f227a16262 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:43.503489 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f8c4e76f-1b65-4052-90d4-00f227a16262 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:43.642080 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-f8c4e76f-1b65-4052-90d4-00f227a16262 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:43.650372 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-f8c4e76f-1b65-4052-90d4-00f227a16262 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d" status: 200 len: 1314 microversion: 2.1 time: 0.162143 Sep 23 15:28:43.669273 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 472/943] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:43 2022] GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:43.891123 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-8c0913e1-650b-4942-85e5-024f460b7943 req-ccfddc7a-3c4f-4b3b-b168-6a1b52c4bf60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1bef03-6235-4e2e-b446-2c19dd4d2b1d", "name": "network-vif-plugged", "status": "completed", "tag": "4da16b6c-5b22-4e9b-9b6f-1bc9305a2379"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:28:43.901570 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-8c0913e1-650b-4942-85e5-024f460b7943 req-ccfddc7a-3c4f-4b3b-b168-6a1b52c4bf60 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:43.902047 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-8c0913e1-650b-4942-85e5-024f460b7943 req-ccfddc7a-3c4f-4b3b-b168-6a1b52c4bf60 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:43.902475 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-8c0913e1-650b-4942-85e5-024f460b7943 req-ccfddc7a-3c4f-4b3b-b168-6a1b52c4bf60 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:43.913321 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-8c0913e1-650b-4942-85e5-024f460b7943 req-ccfddc7a-3c4f-4b3b-b168-6a1b52c4bf60 service nova] Creating event network-vif-plugged:4da16b6c-5b22-4e9b-9b6f-1bc9305a2379 for instance 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d on hv-cinder-85530 Sep 23 15:28:43.919216 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-8c0913e1-650b-4942-85e5-024f460b7943 req-ccfddc7a-3c4f-4b3b-b168-6a1b52c4bf60 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031983 Sep 23 15:28:43.920208 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 472/944] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:28:44.673790 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-e6e1f738-0154-452d-86f4-0b9f942ce8f0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:44.674412 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-e6e1f738-0154-452d-86f4-0b9f942ce8f0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:44.681551 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e6e1f738-0154-452d-86f4-0b9f942ce8f0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:44.682037 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e6e1f738-0154-452d-86f4-0b9f942ce8f0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:44.682477 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e6e1f738-0154-452d-86f4-0b9f942ce8f0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:44.683174 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e6e1f738-0154-452d-86f4-0b9f942ce8f0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:44.683631 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e6e1f738-0154-452d-86f4-0b9f942ce8f0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:44.684085 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e6e1f738-0154-452d-86f4-0b9f942ce8f0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:44.823071 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-e6e1f738-0154-452d-86f4-0b9f942ce8f0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:44.830761 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-e6e1f738-0154-452d-86f4-0b9f942ce8f0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d" status: 200 len: 1314 microversion: 2.1 time: 0.160988 Sep 23 15:28:44.831329 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 473/945] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:44 2022] GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:28:45.854903 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-fec3cf51-4e84-4466-85f2-e5a2cbcbbc2f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:45.855601 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-fec3cf51-4e84-4466-85f2-e5a2cbcbbc2f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:45.862628 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fec3cf51-4e84-4466-85f2-e5a2cbcbbc2f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:45.863122 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fec3cf51-4e84-4466-85f2-e5a2cbcbbc2f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:45.863571 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fec3cf51-4e84-4466-85f2-e5a2cbcbbc2f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:45.864362 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fec3cf51-4e84-4466-85f2-e5a2cbcbbc2f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:45.864821 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fec3cf51-4e84-4466-85f2-e5a2cbcbbc2f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:45.865258 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-fec3cf51-4e84-4466-85f2-e5a2cbcbbc2f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:46.011671 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-fec3cf51-4e84-4466-85f2-e5a2cbcbbc2f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:46.019715 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-fec3cf51-4e84-4466-85f2-e5a2cbcbbc2f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d" status: 200 len: 1314 microversion: 2.1 time: 0.169709 Sep 23 15:28:46.020236 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 473/946] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:45 2022] GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:47.043510 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-6e6a4c20-c7a5-4de6-9258-d06a65fedc6c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:47.044158 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-6e6a4c20-c7a5-4de6-9258-d06a65fedc6c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:47.050891 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e6a4c20-c7a5-4de6-9258-d06a65fedc6c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:47.051375 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e6a4c20-c7a5-4de6-9258-d06a65fedc6c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:47.051815 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e6a4c20-c7a5-4de6-9258-d06a65fedc6c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:47.052538 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e6a4c20-c7a5-4de6-9258-d06a65fedc6c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:47.053000 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e6a4c20-c7a5-4de6-9258-d06a65fedc6c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:47.053426 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e6a4c20-c7a5-4de6-9258-d06a65fedc6c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:47.189387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-6e6a4c20-c7a5-4de6-9258-d06a65fedc6c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:47.197506 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-6e6a4c20-c7a5-4de6-9258-d06a65fedc6c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d" status: 200 len: 1497 microversion: 2.1 time: 0.158365 Sep 23 15:28:47.198086 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 474/947] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:47 2022] GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:47.995478 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-1281c090-252e-4e68-9939-889711dabe10 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:47.996078 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-1281c090-252e-4e68-9939-889711dabe10 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:48.002653 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1281c090-252e-4e68-9939-889711dabe10 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:48.003144 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1281c090-252e-4e68-9939-889711dabe10 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:48.003590 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1281c090-252e-4e68-9939-889711dabe10 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:48.004342 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1281c090-252e-4e68-9939-889711dabe10 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:48.004807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1281c090-252e-4e68-9939-889711dabe10 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:48.005243 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-1281c090-252e-4e68-9939-889711dabe10 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:48.032347 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-1281c090-252e-4e68-9939-889711dabe10 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d] Going to try to terminate instance {{(pid=121448) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:28:48.328773 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-1281c090-252e-4e68-9939-889711dabe10 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "DELETE /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d" status: 204 len: 0 microversion: 2.1 time: 0.337706 Sep 23 15:28:48.329357 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 474/948] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Sep 23 15:28:47 2022] DELETE /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:28:48.337770 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-75764bc5-0ad4-46ce-ae18-db39e72a6d0a tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:48.338467 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-75764bc5-0ad4-46ce-ae18-db39e72a6d0a tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:48.345283 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-75764bc5-0ad4-46ce-ae18-db39e72a6d0a tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:48.345900 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-75764bc5-0ad4-46ce-ae18-db39e72a6d0a tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:48.346181 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-75764bc5-0ad4-46ce-ae18-db39e72a6d0a tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:48.346884 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-75764bc5-0ad4-46ce-ae18-db39e72a6d0a tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:48.347328 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-75764bc5-0ad4-46ce-ae18-db39e72a6d0a tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:48.347747 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-75764bc5-0ad4-46ce-ae18-db39e72a6d0a tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:48.485493 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-75764bc5-0ad4-46ce-ae18-db39e72a6d0a tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:48.493917 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-75764bc5-0ad4-46ce-ae18-db39e72a6d0a tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d" status: 200 len: 1503 microversion: 2.1 time: 0.159921 Sep 23 15:28:48.494494 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 475/949] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:48 2022] GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:49.519409 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-8c629446-cb25-4111-b56c-eefc0d54b60b tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:49.520146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-8c629446-cb25-4111-b56c-eefc0d54b60b tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:49.527323 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8c629446-cb25-4111-b56c-eefc0d54b60b tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:49.527820 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8c629446-cb25-4111-b56c-eefc0d54b60b tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:49.528300 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8c629446-cb25-4111-b56c-eefc0d54b60b tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:49.529034 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8c629446-cb25-4111-b56c-eefc0d54b60b tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:49.529495 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8c629446-cb25-4111-b56c-eefc0d54b60b tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:49.529926 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8c629446-cb25-4111-b56c-eefc0d54b60b tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:49.664372 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-8c629446-cb25-4111-b56c-eefc0d54b60b tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:49.672573 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-8c629446-cb25-4111-b56c-eefc0d54b60b tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d" status: 200 len: 1503 microversion: 2.1 time: 0.157392 Sep 23 15:28:49.673194 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 475/950] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:49 2022] GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:50.280343 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-068d8cfb-4e5f-408f-8226-38abb21e376a req-b985e21d-48a1-4d7e-8f60-195a0c5b8023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1bef03-6235-4e2e-b446-2c19dd4d2b1d", "name": "network-vif-deleted", "tag": "4da16b6c-5b22-4e9b-9b6f-1bc9305a2379"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:28:50.292213 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-068d8cfb-4e5f-408f-8226-38abb21e376a req-b985e21d-48a1-4d7e-8f60-195a0c5b8023 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:50.292697 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-068d8cfb-4e5f-408f-8226-38abb21e376a req-b985e21d-48a1-4d7e-8f60-195a0c5b8023 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:50.293207 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-068d8cfb-4e5f-408f-8226-38abb21e376a req-b985e21d-48a1-4d7e-8f60-195a0c5b8023 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:50.306631 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-068d8cfb-4e5f-408f-8226-38abb21e376a req-b985e21d-48a1-4d7e-8f60-195a0c5b8023 service nova] Creating event network-vif-deleted:4da16b6c-5b22-4e9b-9b6f-1bc9305a2379 for instance 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d on hv-cinder-85530 Sep 23 15:28:50.313295 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-068d8cfb-4e5f-408f-8226-38abb21e376a req-b985e21d-48a1-4d7e-8f60-195a0c5b8023 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035973 Sep 23 15:28:50.313295 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 476/951] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:28:50.696210 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-29755765-0c68-44e3-81e1-2146f89d37a2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:50.696870 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-29755765-0c68-44e3-81e1-2146f89d37a2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:50.699400 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:28:50.704438 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-29755765-0c68-44e3-81e1-2146f89d37a2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:50.705094 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-29755765-0c68-44e3-81e1-2146f89d37a2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:50.705548 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-29755765-0c68-44e3-81e1-2146f89d37a2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:50.706309 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-29755765-0c68-44e3-81e1-2146f89d37a2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:50.706772 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-29755765-0c68-44e3-81e1-2146f89d37a2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:50.707204 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-29755765-0c68-44e3-81e1-2146f89d37a2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:50.711770 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:28:50.745021 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-29755765-0c68-44e3-81e1-2146f89d37a2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:50.745510 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-29755765-0c68-44e3-81e1-2146f89d37a2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:50.745947 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-29755765-0c68-44e3-81e1-2146f89d37a2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:50.746395 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.objects.instance [None req-29755765-0c68-44e3-81e1-2146f89d37a2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lazy-loading 'fault' on Instance uuid 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d {{(pid=121448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:28:50.791397 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-29755765-0c68-44e3-81e1-2146f89d37a2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:50.799831 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-29755765-0c68-44e3-81e1-2146f89d37a2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d" status: 200 len: 1304 microversion: 2.1 time: 0.107692 Sep 23 15:28:50.800444 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 476/952] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:50 2022] GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:51.826075 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-095e29d5-e828-4fb4-8ef2-7835eaaf7ee2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:51.826779 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-095e29d5-e828-4fb4-8ef2-7835eaaf7ee2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:51.833413 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-095e29d5-e828-4fb4-8ef2-7835eaaf7ee2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:51.833901 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-095e29d5-e828-4fb4-8ef2-7835eaaf7ee2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:51.834338 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-095e29d5-e828-4fb4-8ef2-7835eaaf7ee2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:51.835036 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-095e29d5-e828-4fb4-8ef2-7835eaaf7ee2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:51.835502 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-095e29d5-e828-4fb4-8ef2-7835eaaf7ee2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:51.836115 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-095e29d5-e828-4fb4-8ef2-7835eaaf7ee2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:51.851131 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-095e29d5-e828-4fb4-8ef2-7835eaaf7ee2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] HTTP exception thrown: Instance 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d could not be found. Sep 23 15:28:51.853302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-095e29d5-e828-4fb4-8ef2-7835eaaf7ee2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Request method failure captured: Sep 23 15:28:51.853302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d HTTP/1.1 Sep 23 15:28:51.853302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:28:51.853302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:28:51.853302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:28:51.853302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:28:51.853302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:28:51.853302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:28:51.853302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:28:51.853302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:28:51.853302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLdCcoE3KlV5M3mKrvJtH0M27rf7DYchb7tlg3nI-UdnmU3rFKCVB7ZbYwuOOqzlmgNpDES66wBvXdYGIn1vVomjxptj42N29JLeG9PBw8Wiw3uNrvZRn5oVjbHUlLiWiyrrQVWyFWTBFuZIylqQUZRDABvD_UU6oBGvln-p60c1OJiI Sep 23 15:28:51.853302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:28:51.853302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:28:51.853302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:28:51.853302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:28:51.853302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:28:51.853302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:28:51.853302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: 719783ecf917404294351bbb445b9f1b Sep 23 15:28:51.853302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-VolumesActionsTest-177363007 Sep 23 15:28:51.853302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:28:51.853302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:28:51.854947 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/719783ecf917404294351bbb445b9f1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/719783ecf917404294351bbb445b9f1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_719783ecf917404294351bbb445b9f1b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/719783ecf917404294351bbb445b9f1b"}]}] Sep 23 15:28:51.854947 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-VolumesActionsTest-177363007 Sep 23 15:28:51.854947 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: 719783ecf917404294351bbb445b9f1b Sep 23 15:28:51.854947 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-VolumesActionsTest-177363007 Sep 23 15:28:51.854947 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-VolumesActionsTest-177363007-project Sep 23 15:28:51.854947 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:28:51.854947 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:28:51.854947 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 78bb70c49abc42cabecb413112fbb31a Sep 23 15:28:51.854947 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-VolumesActionsTest-177363007-project Sep 23 15:28:51.854947 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:28:51.854947 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d could not be found. Sep 23 15:28:51.854947 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '4e1bef03-6235-4e2e-b446-2c19dd4d2b1d'} Sep 23 15:28:51.855945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:28:51.855945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:51.855945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:28:51.855945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:28:51.855945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:28:51.855945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:28:51.855945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:28:51.855945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:28:51.855945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:28:51.855945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:28:51.855945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d could not be found. Sep 23 15:28:51.855945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:28:51.855945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:28:51.855945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:28:51.855945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:51.855945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:28:51.855945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:28:51.855945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:28:51.855945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:28:51.855945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:28:51.857550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:28:51.857550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:28:51.857550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:28:51.857550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:28:51.857550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:28:51.857550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:28:51.857550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:28:51.857550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d could not be found. Sep 23 15:28:51.857550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:28:51.857550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:28:51.857550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:28:51.857550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:51.857550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:28:51.857550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:28:51.857550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:28:51.857550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:28:51.857550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d could not be found. Sep 23 15:28:51.857550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:28:51.858893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-095e29d5-e828-4fb4-8ef2-7835eaaf7ee2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Returning 404 to user: Instance 4e1bef03-6235-4e2e-b446-2c19dd4d2b1d could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:28:51.858893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-095e29d5-e828-4fb4-8ef2-7835eaaf7ee2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d" status: 404 len: 111 microversion: 2.1 time: 0.033484 Sep 23 15:28:51.858893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 477/953] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:51 2022] GET /compute/v2.1/servers/4e1bef03-6235-4e2e-b446-2c19dd4d2b1d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:28:51.909572 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-55fefe54-3aa2-484e-a31b-aebfb5c60c87 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2129098156", "imageRef": "051c4746-7f50-4edb-b09d-a8935df360de", "flavorRef": "452", "networks": [{"uuid": "92097787-289b-4a33-8ae1-9d8232d75ce8"}]}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:28:51.972805 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.network.neutron [None req-55fefe54-3aa2-484e-a31b-aebfb5c60c87 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] validate_networks() for [('92097787-289b-4a33-8ae1-9d8232d75ce8', None, None, None, None, None)] {{(pid=121448) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:28:52.377146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-55fefe54-3aa2-484e-a31b-aebfb5c60c87 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Flavor limits 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:28:52.377577 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-55fefe54-3aa2-484e-a31b-aebfb5c60c87 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Image limits 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:28:52.378054 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-55fefe54-3aa2-484e-a31b-aebfb5c60c87 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Flavor pref 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:28:52.378470 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-55fefe54-3aa2-484e-a31b-aebfb5c60c87 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Image pref 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:28:52.378881 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-55fefe54-3aa2-484e-a31b-aebfb5c60c87 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:28:52.388377 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-55fefe54-3aa2-484e-a31b-aebfb5c60c87 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:52.388859 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-55fefe54-3aa2-484e-a31b-aebfb5c60c87 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:52.389297 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-55fefe54-3aa2-484e-a31b-aebfb5c60c87 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:52.390026 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-55fefe54-3aa2-484e-a31b-aebfb5c60c87 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:52.390509 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-55fefe54-3aa2-484e-a31b-aebfb5c60c87 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:52.390945 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-55fefe54-3aa2-484e-a31b-aebfb5c60c87 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:52.409824 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-55fefe54-3aa2-484e-a31b-aebfb5c60c87 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Getting quotas for project 719783ecf917404294351bbb445b9f1b. Resources: {'ram', 'instances', 'cores'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:28:52.417214 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-55fefe54-3aa2-484e-a31b-aebfb5c60c87 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Getting quotas for user 78bb70c49abc42cabecb413112fbb31a and project 719783ecf917404294351bbb445b9f1b. Resources: {'ram', 'instances', 'cores'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:28:52.437110 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-55fefe54-3aa2-484e-a31b-aebfb5c60c87 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Going to run 1 instances... {{(pid=121448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:28:52.441411 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-55fefe54-3aa2-484e-a31b-aebfb5c60c87 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: ad1f807b-30e2-437c-9bb7-a09b46f93e3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='051c4746-7f50-4edb-b09d-a8935df360de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:28:52.650756 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-55fefe54-3aa2-484e-a31b-aebfb5c60c87 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.745814 Sep 23 15:28:52.651333 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 477/954] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Sep 23 15:28:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:28:52.662513 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-dfb2a250-ca9b-49c6-ad37-9d2548d76a9b tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:52.663133 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-dfb2a250-ca9b-49c6-ad37-9d2548d76a9b tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: ad1f807b-30e2-437c-9bb7-a09b46f93e3e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:52.723148 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-dfb2a250-ca9b-49c6-ad37-9d2548d76a9b tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:52.730516 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-dfb2a250-ca9b-49c6-ad37-9d2548d76a9b tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e" status: 200 len: 1214 microversion: 2.1 time: 0.071852 Sep 23 15:28:52.731096 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 478/955] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:52 2022] GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:53.756997 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-7c20ae7b-1bc7-4a06-b05d-dd8e5d3fa8c9 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:53.759273 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-7c20ae7b-1bc7-4a06-b05d-dd8e5d3fa8c9 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: ad1f807b-30e2-437c-9bb7-a09b46f93e3e] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:53.767426 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7c20ae7b-1bc7-4a06-b05d-dd8e5d3fa8c9 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:53.767930 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7c20ae7b-1bc7-4a06-b05d-dd8e5d3fa8c9 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:53.768503 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7c20ae7b-1bc7-4a06-b05d-dd8e5d3fa8c9 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:53.769301 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7c20ae7b-1bc7-4a06-b05d-dd8e5d3fa8c9 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:53.769821 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7c20ae7b-1bc7-4a06-b05d-dd8e5d3fa8c9 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:53.770275 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-7c20ae7b-1bc7-4a06-b05d-dd8e5d3fa8c9 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:53.845896 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-7c20ae7b-1bc7-4a06-b05d-dd8e5d3fa8c9 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:53.855082 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-7c20ae7b-1bc7-4a06-b05d-dd8e5d3fa8c9 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e" status: 200 len: 1218 microversion: 2.1 time: 0.104455 Sep 23 15:28:53.855787 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 478/956] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:53 2022] GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:54.879108 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b1f3b95d-ab51-4e8d-b3ba-dfc9244a56d9 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:54.880008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-b1f3b95d-ab51-4e8d-b3ba-dfc9244a56d9 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: ad1f807b-30e2-437c-9bb7-a09b46f93e3e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:54.890166 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b1f3b95d-ab51-4e8d-b3ba-dfc9244a56d9 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:54.891772 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b1f3b95d-ab51-4e8d-b3ba-dfc9244a56d9 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:54.892317 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b1f3b95d-ab51-4e8d-b3ba-dfc9244a56d9 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:54.893186 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b1f3b95d-ab51-4e8d-b3ba-dfc9244a56d9 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:54.893807 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b1f3b95d-ab51-4e8d-b3ba-dfc9244a56d9 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:54.894379 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b1f3b95d-ab51-4e8d-b3ba-dfc9244a56d9 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:55.020332 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-b1f3b95d-ab51-4e8d-b3ba-dfc9244a56d9 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:55.040556 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-b1f3b95d-ab51-4e8d-b3ba-dfc9244a56d9 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e" status: 200 len: 1284 microversion: 2.1 time: 0.165338 Sep 23 15:28:55.041493 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 479/957] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:54 2022] GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e => generated 1284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:56.072333 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-20557f70-6659-4af9-b723-f3c9f3c499d0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:56.073573 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-20557f70-6659-4af9-b723-f3c9f3c499d0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: ad1f807b-30e2-437c-9bb7-a09b46f93e3e] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:56.081678 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-20557f70-6659-4af9-b723-f3c9f3c499d0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:56.082344 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-20557f70-6659-4af9-b723-f3c9f3c499d0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:56.082796 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-20557f70-6659-4af9-b723-f3c9f3c499d0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:56.083662 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-20557f70-6659-4af9-b723-f3c9f3c499d0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:56.083972 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-20557f70-6659-4af9-b723-f3c9f3c499d0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:56.084440 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-20557f70-6659-4af9-b723-f3c9f3c499d0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:56.244832 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-20557f70-6659-4af9-b723-f3c9f3c499d0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:56.253926 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-20557f70-6659-4af9-b723-f3c9f3c499d0 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e" status: 200 len: 1314 microversion: 2.1 time: 0.188926 Sep 23 15:28:56.254515 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 479/958] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:56 2022] GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:56.710589 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-5ab07b0a-cee1-479e-8fcf-7ff2b0bc5cca req-c9dc40a0-27fa-4f57-80dd-de5eeb21c5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad1f807b-30e2-437c-9bb7-a09b46f93e3e", "tag": "7d77f44a-b87f-44ff-8156-b0bc875a7b02"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:28:56.720625 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:28:56.730605 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-5ab07b0a-cee1-479e-8fcf-7ff2b0bc5cca req-c9dc40a0-27fa-4f57-80dd-de5eeb21c5d1 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:56.731497 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-5ab07b0a-cee1-479e-8fcf-7ff2b0bc5cca req-c9dc40a0-27fa-4f57-80dd-de5eeb21c5d1 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:56.732292 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-5ab07b0a-cee1-479e-8fcf-7ff2b0bc5cca req-c9dc40a0-27fa-4f57-80dd-de5eeb21c5d1 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:56.749767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-5ab07b0a-cee1-479e-8fcf-7ff2b0bc5cca req-c9dc40a0-27fa-4f57-80dd-de5eeb21c5d1 service nova] Creating event network-changed:7d77f44a-b87f-44ff-8156-b0bc875a7b02 for instance ad1f807b-30e2-437c-9bb7-a09b46f93e3e on hv-cinder-85530 Sep 23 15:28:56.755194 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-5ab07b0a-cee1-479e-8fcf-7ff2b0bc5cca req-c9dc40a0-27fa-4f57-80dd-de5eeb21c5d1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052056 Sep 23 15:28:56.755801 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 480/959] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:28:57.284244 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a8d0095a-0586-4244-a5b9-60cd84d0db94 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:57.285433 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-a8d0095a-0586-4244-a5b9-60cd84d0db94 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: ad1f807b-30e2-437c-9bb7-a09b46f93e3e] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:57.297655 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a8d0095a-0586-4244-a5b9-60cd84d0db94 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:57.298502 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a8d0095a-0586-4244-a5b9-60cd84d0db94 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:57.299272 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a8d0095a-0586-4244-a5b9-60cd84d0db94 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:57.300611 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a8d0095a-0586-4244-a5b9-60cd84d0db94 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:57.301442 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a8d0095a-0586-4244-a5b9-60cd84d0db94 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:57.302270 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a8d0095a-0586-4244-a5b9-60cd84d0db94 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:57.485404 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a8d0095a-0586-4244-a5b9-60cd84d0db94 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:57.496792 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-a8d0095a-0586-4244-a5b9-60cd84d0db94 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e" status: 200 len: 1314 microversion: 2.1 time: 0.219579 Sep 23 15:28:57.497273 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 480/960] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:57 2022] GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:58.522440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-7ff0a8e2-fc59-40be-9c71-e91177feef1c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:58.523733 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-7ff0a8e2-fc59-40be-9c71-e91177feef1c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: ad1f807b-30e2-437c-9bb7-a09b46f93e3e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:58.530357 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7ff0a8e2-fc59-40be-9c71-e91177feef1c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:58.530895 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7ff0a8e2-fc59-40be-9c71-e91177feef1c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:58.531478 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7ff0a8e2-fc59-40be-9c71-e91177feef1c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:58.532351 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7ff0a8e2-fc59-40be-9c71-e91177feef1c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:58.532898 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7ff0a8e2-fc59-40be-9c71-e91177feef1c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:58.533496 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7ff0a8e2-fc59-40be-9c71-e91177feef1c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:58.536566 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=99 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:28:58.689960 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-7ff0a8e2-fc59-40be-9c71-e91177feef1c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:58.698934 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-7ff0a8e2-fc59-40be-9c71-e91177feef1c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e" status: 200 len: 1314 microversion: 2.1 time: 0.182237 Sep 23 15:28:58.699522 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 481/961] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:58 2022] GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:28:59.742311 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-8a7d7ee8-9d4d-44ad-9584-ecb0e7de707f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:59.743667 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-8a7d7ee8-9d4d-44ad-9584-ecb0e7de707f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: ad1f807b-30e2-437c-9bb7-a09b46f93e3e] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:59.754862 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8a7d7ee8-9d4d-44ad-9584-ecb0e7de707f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:59.755731 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8a7d7ee8-9d4d-44ad-9584-ecb0e7de707f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:59.756561 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8a7d7ee8-9d4d-44ad-9584-ecb0e7de707f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:59.757821 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8a7d7ee8-9d4d-44ad-9584-ecb0e7de707f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:59.758629 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8a7d7ee8-9d4d-44ad-9584-ecb0e7de707f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:59.759384 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8a7d7ee8-9d4d-44ad-9584-ecb0e7de707f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:59.902765 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-8a7d7ee8-9d4d-44ad-9584-ecb0e7de707f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:59.911328 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-8a7d7ee8-9d4d-44ad-9584-ecb0e7de707f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e" status: 200 len: 1314 microversion: 2.1 time: 0.176855 Sep 23 15:28:59.911925 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 481/962] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:59 2022] GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:00.936719 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-fc98b482-8ca2-4e25-bba0-37c1c1b2a136 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:00.937659 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-fc98b482-8ca2-4e25-bba0-37c1c1b2a136 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: ad1f807b-30e2-437c-9bb7-a09b46f93e3e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:00.945334 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fc98b482-8ca2-4e25-bba0-37c1c1b2a136 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:00.946312 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fc98b482-8ca2-4e25-bba0-37c1c1b2a136 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:00.946452 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fc98b482-8ca2-4e25-bba0-37c1c1b2a136 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:00.947075 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fc98b482-8ca2-4e25-bba0-37c1c1b2a136 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:00.947559 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fc98b482-8ca2-4e25-bba0-37c1c1b2a136 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:00.948022 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fc98b482-8ca2-4e25-bba0-37c1c1b2a136 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:01.099021 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-fc98b482-8ca2-4e25-bba0-37c1c1b2a136 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:01.113369 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-fc98b482-8ca2-4e25-bba0-37c1c1b2a136 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e" status: 200 len: 1314 microversion: 2.1 time: 0.180821 Sep 23 15:29:01.114281 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 482/963] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:00 2022] GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:29:02.141312 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a57c97a5-6ddc-4c91-9d21-11973d84640c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:02.142122 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-a57c97a5-6ddc-4c91-9d21-11973d84640c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: ad1f807b-30e2-437c-9bb7-a09b46f93e3e] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:02.153256 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a57c97a5-6ddc-4c91-9d21-11973d84640c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:02.154134 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a57c97a5-6ddc-4c91-9d21-11973d84640c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:02.154637 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a57c97a5-6ddc-4c91-9d21-11973d84640c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:02.155416 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a57c97a5-6ddc-4c91-9d21-11973d84640c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:02.156090 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a57c97a5-6ddc-4c91-9d21-11973d84640c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:02.156712 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a57c97a5-6ddc-4c91-9d21-11973d84640c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:02.314456 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-a57c97a5-6ddc-4c91-9d21-11973d84640c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:02.323589 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-a57c97a5-6ddc-4c91-9d21-11973d84640c tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e" status: 200 len: 1314 microversion: 2.1 time: 0.187628 Sep 23 15:29:02.324394 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 482/964] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:02 2022] GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:03.348235 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-4048ff86-e4da-496a-93a4-93c3b5e61f6f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:03.348801 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-4048ff86-e4da-496a-93a4-93c3b5e61f6f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: ad1f807b-30e2-437c-9bb7-a09b46f93e3e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:03.352237 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell0:SELECT=2 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:29:03.357188 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4048ff86-e4da-496a-93a4-93c3b5e61f6f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:03.357673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4048ff86-e4da-496a-93a4-93c3b5e61f6f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:03.358113 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4048ff86-e4da-496a-93a4-93c3b5e61f6f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:03.358821 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4048ff86-e4da-496a-93a4-93c3b5e61f6f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:03.359307 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4048ff86-e4da-496a-93a4-93c3b5e61f6f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:03.359733 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4048ff86-e4da-496a-93a4-93c3b5e61f6f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:03.512249 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-4048ff86-e4da-496a-93a4-93c3b5e61f6f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:03.521137 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-4048ff86-e4da-496a-93a4-93c3b5e61f6f tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e" status: 200 len: 1314 microversion: 2.1 time: 0.176746 Sep 23 15:29:03.521737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 483/965] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:03 2022] GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:03.988755 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-1bb80e0d-1f18-4c38-8ef6-4351b619f686 req-993c8b1d-afb2-445d-a7be-9625cecabe04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad1f807b-30e2-437c-9bb7-a09b46f93e3e", "name": "network-vif-plugged", "status": "completed", "tag": "7d77f44a-b87f-44ff-8156-b0bc875a7b02"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:29:03.994815 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell0:SELECT=2 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:29:03.995492 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell0:SELECT=6 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:29:04.001272 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-1bb80e0d-1f18-4c38-8ef6-4351b619f686 req-993c8b1d-afb2-445d-a7be-9625cecabe04 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:04.001760 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-1bb80e0d-1f18-4c38-8ef6-4351b619f686 req-993c8b1d-afb2-445d-a7be-9625cecabe04 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:04.002196 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-1bb80e0d-1f18-4c38-8ef6-4351b619f686 req-993c8b1d-afb2-445d-a7be-9625cecabe04 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:04.017528 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-1bb80e0d-1f18-4c38-8ef6-4351b619f686 req-993c8b1d-afb2-445d-a7be-9625cecabe04 service nova] Creating event network-vif-plugged:7d77f44a-b87f-44ff-8156-b0bc875a7b02 for instance ad1f807b-30e2-437c-9bb7-a09b46f93e3e on hv-cinder-85530 Sep 23 15:29:04.023572 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-1bb80e0d-1f18-4c38-8ef6-4351b619f686 req-993c8b1d-afb2-445d-a7be-9625cecabe04 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037971 Sep 23 15:29:04.024400 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 483/966] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:29:04.545176 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-9484874d-7140-4080-9976-c120b3058cce tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:04.545791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-9484874d-7140-4080-9976-c120b3058cce tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: ad1f807b-30e2-437c-9bb7-a09b46f93e3e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:04.552577 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9484874d-7140-4080-9976-c120b3058cce tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:04.553067 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9484874d-7140-4080-9976-c120b3058cce tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:04.553502 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9484874d-7140-4080-9976-c120b3058cce tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:04.555109 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9484874d-7140-4080-9976-c120b3058cce tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:04.555567 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9484874d-7140-4080-9976-c120b3058cce tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:04.556014 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9484874d-7140-4080-9976-c120b3058cce tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:04.697111 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-9484874d-7140-4080-9976-c120b3058cce tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:04.705647 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-9484874d-7140-4080-9976-c120b3058cce tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e" status: 200 len: 1314 microversion: 2.1 time: 0.164200 Sep 23 15:29:04.712042 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 484/967] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:04 2022] GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:05.729451 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-2c24414e-d3e2-4b38-a78f-9709cab4b3db tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:05.730183 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-2c24414e-d3e2-4b38-a78f-9709cab4b3db tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: ad1f807b-30e2-437c-9bb7-a09b46f93e3e] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:05.737538 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2c24414e-d3e2-4b38-a78f-9709cab4b3db tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:05.738026 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2c24414e-d3e2-4b38-a78f-9709cab4b3db tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:05.738468 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2c24414e-d3e2-4b38-a78f-9709cab4b3db tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:05.739202 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2c24414e-d3e2-4b38-a78f-9709cab4b3db tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:05.739627 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2c24414e-d3e2-4b38-a78f-9709cab4b3db tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:05.740093 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-2c24414e-d3e2-4b38-a78f-9709cab4b3db tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:05.885375 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-2c24414e-d3e2-4b38-a78f-9709cab4b3db tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:05.894139 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-2c24414e-d3e2-4b38-a78f-9709cab4b3db tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e" status: 200 len: 1314 microversion: 2.1 time: 0.169263 Sep 23 15:29:05.894734 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 484/968] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:05 2022] GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:06.918554 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-79a6a7f3-2bb1-4012-b77d-2dc3f53db3c8 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:06.919156 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-79a6a7f3-2bb1-4012-b77d-2dc3f53db3c8 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: ad1f807b-30e2-437c-9bb7-a09b46f93e3e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:06.925879 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-79a6a7f3-2bb1-4012-b77d-2dc3f53db3c8 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:06.926369 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-79a6a7f3-2bb1-4012-b77d-2dc3f53db3c8 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:06.926814 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-79a6a7f3-2bb1-4012-b77d-2dc3f53db3c8 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:06.927508 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-79a6a7f3-2bb1-4012-b77d-2dc3f53db3c8 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:06.927963 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-79a6a7f3-2bb1-4012-b77d-2dc3f53db3c8 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:06.928409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-79a6a7f3-2bb1-4012-b77d-2dc3f53db3c8 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:07.059916 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-79a6a7f3-2bb1-4012-b77d-2dc3f53db3c8 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:07.067930 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-79a6a7f3-2bb1-4012-b77d-2dc3f53db3c8 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e" status: 200 len: 1497 microversion: 2.1 time: 0.153335 Sep 23 15:29:07.068537 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 485/969] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:06 2022] GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:07.888605 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-a76357eb-23e8-4524-9246-b4b76498ade2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:07.889145 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-a76357eb-23e8-4524-9246-b4b76498ade2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: ad1f807b-30e2-437c-9bb7-a09b46f93e3e] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:07.895682 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a76357eb-23e8-4524-9246-b4b76498ade2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:07.896274 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a76357eb-23e8-4524-9246-b4b76498ade2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:07.896737 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a76357eb-23e8-4524-9246-b4b76498ade2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:07.897467 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a76357eb-23e8-4524-9246-b4b76498ade2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:07.898511 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a76357eb-23e8-4524-9246-b4b76498ade2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:07.898942 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-a76357eb-23e8-4524-9246-b4b76498ade2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:07.925689 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-a76357eb-23e8-4524-9246-b4b76498ade2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: ad1f807b-30e2-437c-9bb7-a09b46f93e3e] Going to try to terminate instance {{(pid=121448) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:29:08.289088 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-a76357eb-23e8-4524-9246-b4b76498ade2 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e" status: 204 len: 0 microversion: 2.1 time: 0.403506 Sep 23 15:29:08.289680 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 485/970] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Sep 23 15:29:07 2022] DELETE /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 15:29:08.298043 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-6077c000-c563-42d1-ad32-3a896a7b7628 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:08.298655 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-6077c000-c563-42d1-ad32-3a896a7b7628 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: ad1f807b-30e2-437c-9bb7-a09b46f93e3e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:08.305601 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6077c000-c563-42d1-ad32-3a896a7b7628 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:08.310474 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6077c000-c563-42d1-ad32-3a896a7b7628 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:08.310474 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6077c000-c563-42d1-ad32-3a896a7b7628 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:08.310474 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6077c000-c563-42d1-ad32-3a896a7b7628 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:08.310474 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6077c000-c563-42d1-ad32-3a896a7b7628 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:08.310897 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6077c000-c563-42d1-ad32-3a896a7b7628 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:08.437476 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-6077c000-c563-42d1-ad32-3a896a7b7628 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:08.446264 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-6077c000-c563-42d1-ad32-3a896a7b7628 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e" status: 200 len: 1503 microversion: 2.1 time: 0.152226 Sep 23 15:29:08.446851 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 486/971] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:08 2022] GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:09.471205 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-181cfe29-dbb2-4f96-b6af-f04abe57ac03 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:09.471908 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-181cfe29-dbb2-4f96-b6af-f04abe57ac03 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: ad1f807b-30e2-437c-9bb7-a09b46f93e3e] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:09.478806 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-181cfe29-dbb2-4f96-b6af-f04abe57ac03 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:09.479299 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-181cfe29-dbb2-4f96-b6af-f04abe57ac03 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:09.479740 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-181cfe29-dbb2-4f96-b6af-f04abe57ac03 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:09.480461 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-181cfe29-dbb2-4f96-b6af-f04abe57ac03 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:09.480920 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-181cfe29-dbb2-4f96-b6af-f04abe57ac03 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:09.481346 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-181cfe29-dbb2-4f96-b6af-f04abe57ac03 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:09.619607 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-181cfe29-dbb2-4f96-b6af-f04abe57ac03 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:09.627752 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-181cfe29-dbb2-4f96-b6af-f04abe57ac03 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e" status: 200 len: 1503 microversion: 2.1 time: 0.160759 Sep 23 15:29:09.629565 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 486/972] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:09 2022] GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:10.643027 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-ab8e618b-c45d-4cf2-aa5f-c3b623794c2f req-4b6bdf88-94e4-47f3-aa4c-e12905bb282f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad1f807b-30e2-437c-9bb7-a09b46f93e3e", "name": "network-vif-deleted", "tag": "7d77f44a-b87f-44ff-8156-b0bc875a7b02"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:29:10.651230 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-c9e633e4-1d4c-4607-87f0-1ccde23b5659 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:10.651853 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-c9e633e4-1d4c-4607-87f0-1ccde23b5659 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: ad1f807b-30e2-437c-9bb7-a09b46f93e3e] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:10.654573 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-ab8e618b-c45d-4cf2-aa5f-c3b623794c2f req-4b6bdf88-94e4-47f3-aa4c-e12905bb282f service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:10.655157 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-ab8e618b-c45d-4cf2-aa5f-c3b623794c2f req-4b6bdf88-94e4-47f3-aa4c-e12905bb282f service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:10.655586 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-ab8e618b-c45d-4cf2-aa5f-c3b623794c2f req-4b6bdf88-94e4-47f3-aa4c-e12905bb282f service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:10.658845 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c9e633e4-1d4c-4607-87f0-1ccde23b5659 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:10.659336 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c9e633e4-1d4c-4607-87f0-1ccde23b5659 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:10.659818 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c9e633e4-1d4c-4607-87f0-1ccde23b5659 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:10.660582 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c9e633e4-1d4c-4607-87f0-1ccde23b5659 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:10.661050 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c9e633e4-1d4c-4607-87f0-1ccde23b5659 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:10.661480 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-c9e633e4-1d4c-4607-87f0-1ccde23b5659 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:10.667824 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-ab8e618b-c45d-4cf2-aa5f-c3b623794c2f req-4b6bdf88-94e4-47f3-aa4c-e12905bb282f service nova] Creating event network-vif-deleted:7d77f44a-b87f-44ff-8156-b0bc875a7b02 for instance ad1f807b-30e2-437c-9bb7-a09b46f93e3e on hv-cinder-85530 Sep 23 15:29:10.672821 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-ab8e618b-c45d-4cf2-aa5f-c3b623794c2f req-4b6bdf88-94e4-47f3-aa4c-e12905bb282f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033657 Sep 23 15:29:10.673531 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 487/973] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:29:10.726025 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-c9e633e4-1d4c-4607-87f0-1ccde23b5659 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:10.734395 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-c9e633e4-1d4c-4607-87f0-1ccde23b5659 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e" status: 200 len: 1461 microversion: 2.1 time: 0.087523 Sep 23 15:29:10.734971 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 487/974] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:10 2022] GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e => generated 1461 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:29:11.759828 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-8f35fa41-4449-4968-91b6-83f425fb11ed tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:11.760612 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-8f35fa41-4449-4968-91b6-83f425fb11ed tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: ad1f807b-30e2-437c-9bb7-a09b46f93e3e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:11.767432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8f35fa41-4449-4968-91b6-83f425fb11ed tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:11.767913 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8f35fa41-4449-4968-91b6-83f425fb11ed tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:11.768376 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8f35fa41-4449-4968-91b6-83f425fb11ed tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:11.769073 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8f35fa41-4449-4968-91b6-83f425fb11ed tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:11.769530 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8f35fa41-4449-4968-91b6-83f425fb11ed tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:11.769960 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8f35fa41-4449-4968-91b6-83f425fb11ed tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:11.807652 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8f35fa41-4449-4968-91b6-83f425fb11ed tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:11.808175 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8f35fa41-4449-4968-91b6-83f425fb11ed tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:11.808618 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8f35fa41-4449-4968-91b6-83f425fb11ed tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:11.809074 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.objects.instance [None req-8f35fa41-4449-4968-91b6-83f425fb11ed tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lazy-loading 'fault' on Instance uuid ad1f807b-30e2-437c-9bb7-a09b46f93e3e {{(pid=121450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:29:11.855169 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-8f35fa41-4449-4968-91b6-83f425fb11ed tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bb70c49abc42cabecb413112fbb31a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719783ecf917404294351bbb445b9f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:11.862469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-8f35fa41-4449-4968-91b6-83f425fb11ed tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e" status: 200 len: 1304 microversion: 2.1 time: 0.107698 Sep 23 15:29:11.863122 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 488/975] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:11 2022] GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:12.887049 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-927b72d3-cead-4fc7-9828-e83f80dae677 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:12.887688 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-927b72d3-cead-4fc7-9828-e83f80dae677 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] [instance: ad1f807b-30e2-437c-9bb7-a09b46f93e3e] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:12.894129 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-927b72d3-cead-4fc7-9828-e83f80dae677 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:12.894605 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-927b72d3-cead-4fc7-9828-e83f80dae677 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:12.895036 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-927b72d3-cead-4fc7-9828-e83f80dae677 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:12.895715 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-927b72d3-cead-4fc7-9828-e83f80dae677 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:12.896207 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-927b72d3-cead-4fc7-9828-e83f80dae677 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:12.896622 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-927b72d3-cead-4fc7-9828-e83f80dae677 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:12.910218 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.wsgi [None req-927b72d3-cead-4fc7-9828-e83f80dae677 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] HTTP exception thrown: Instance ad1f807b-30e2-437c-9bb7-a09b46f93e3e could not be found. Sep 23 15:29:12.911887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-927b72d3-cead-4fc7-9828-e83f80dae677 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Request method failure captured: Sep 23 15:29:12.911887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: request: GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e HTTP/1.1 Sep 23 15:29:12.911887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept: application/json Sep 23 15:29:12.911887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Accept-Encoding: identity Sep 23 15:29:12.911887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Connection: close Sep 23 15:29:12.911887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Length: 0 Sep 23 15:29:12.911887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Content-Type: application/json Sep 23 15:29:12.911887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Host: 10.222.0.55 Sep 23 15:29:12.911887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Openstack-System-Scope: None Sep 23 15:29:12.911887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: User-Agent: python-urllib3/1.26.12 Sep 23 15:29:12.911887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Auth-Token: gAAAAABjLdCcoE3KlV5M3mKrvJtH0M27rf7DYchb7tlg3nI-UdnmU3rFKCVB7ZbYwuOOqzlmgNpDES66wBvXdYGIn1vVomjxptj42N29JLeG9PBw8Wiw3uNrvZRn5oVjbHUlLiWiyrrQVWyFWTBFuZIylqQUZRDABvD_UU6oBGvln-p60c1OJiI Sep 23 15:29:12.911887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Id: None Sep 23 15:29:12.911887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Domain-Name: None Sep 23 15:29:12.911887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Identity-Status: Confirmed Sep 23 15:29:12.911887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Is-Admin-Project: True Sep 23 15:29:12.911887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Id: default Sep 23 15:29:12.911887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Domain-Name: Default Sep 23 15:29:12.911887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Id: 719783ecf917404294351bbb445b9f1b Sep 23 15:29:12.911887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Project-Name: tempest-VolumesActionsTest-177363007 Sep 23 15:29:12.911887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Role: reader,member Sep 23 15:29:12.911887 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Roles: reader,member Sep 23 15:29:12.914338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/719783ecf917404294351bbb445b9f1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/719783ecf917404294351bbb445b9f1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_719783ecf917404294351bbb445b9f1b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/719783ecf917404294351bbb445b9f1b"}]}] Sep 23 15:29:12.914338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant: tempest-VolumesActionsTest-177363007 Sep 23 15:29:12.914338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Id: 719783ecf917404294351bbb445b9f1b Sep 23 15:29:12.914338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-Tenant-Name: tempest-VolumesActionsTest-177363007 Sep 23 15:29:12.914338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User: tempest-VolumesActionsTest-177363007-project Sep 23 15:29:12.914338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Id: default Sep 23 15:29:12.914338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Domain-Name: Default Sep 23 15:29:12.914338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Id: 78bb70c49abc42cabecb413112fbb31a Sep 23 15:29:12.914338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: X-User-Name: tempest-VolumesActionsTest-177363007-project Sep 23 15:29:12.914338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: method: > Sep 23 15:29:12.914338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: exception: Instance ad1f807b-30e2-437c-9bb7-a09b46f93e3e could not be found. Sep 23 15:29:12.914338 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: action_args: {'id': 'ad1f807b-30e2-437c-9bb7-a09b46f93e3e'} Sep 23 15:29:12.915352 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:29:12.915352 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:29:12.915352 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:29:12.915352 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:29:12.915352 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:29:12.915352 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:29:12.915352 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:29:12.915352 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:29:12.915352 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:29:12.915352 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:29:12.915352 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad1f807b-30e2-437c-9bb7-a09b46f93e3e could not be found. Sep 23 15:29:12.915352 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:29:12.915352 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:29:12.915352 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:29:12.915352 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:29:12.915352 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:29:12.915352 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:29:12.915352 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:29:12.915352 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:29:12.915352 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:29:12.916988 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:29:12.916988 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:29:12.916988 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:29:12.916988 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:29:12.916988 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:29:12.916988 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:29:12.916988 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:29:12.916988 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad1f807b-30e2-437c-9bb7-a09b46f93e3e could not be found. Sep 23 15:29:12.916988 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:29:12.916988 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:29:12.916988 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:29:12.916988 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:29:12.916988 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:29:12.916988 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:29:12.916988 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:29:12.916988 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:29:12.916988 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad1f807b-30e2-437c-9bb7-a09b46f93e3e could not be found. Sep 23 15:29:12.916988 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: ERROR nova.api.openstack.wsgi Sep 23 15:29:12.918478 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-927b72d3-cead-4fc7-9828-e83f80dae677 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] Returning 404 to user: Instance ad1f807b-30e2-437c-9bb7-a09b46f93e3e could not be found. {{(pid=121448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:29:12.918478 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-927b72d3-cead-4fc7-9828-e83f80dae677 tempest-VolumesActionsTest-177363007 tempest-VolumesActionsTest-177363007-project] 10.222.0.55 "GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e" status: 404 len: 111 microversion: 2.1 time: 0.030151 Sep 23 15:29:12.918478 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 488/976] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:12 2022] GET /compute/v2.1/servers/ad1f807b-30e2-437c-9bb7-a09b46f93e3e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:29:13.547456 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-f663eb25-610e-4107-8d50-f3dc24d0195d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:13.548163 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-f663eb25-610e-4107-8d50-f3dc24d0195d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:13.555829 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f663eb25-610e-4107-8d50-f3dc24d0195d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:13.556411 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f663eb25-610e-4107-8d50-f3dc24d0195d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:13.561437 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f663eb25-610e-4107-8d50-f3dc24d0195d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:13.561437 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f663eb25-610e-4107-8d50-f3dc24d0195d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:13.561437 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f663eb25-610e-4107-8d50-f3dc24d0195d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:13.561437 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f663eb25-610e-4107-8d50-f3dc24d0195d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:13.588633 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-f663eb25-610e-4107-8d50-f3dc24d0195d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0/ips" status: 200 len: 148 microversion: 2.1 time: 0.045179 Sep 23 15:29:13.589439 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 489/977] 10.222.0.55 () {58 vars in 1248 bytes} [Fri Sep 23 15:29:13 2022] GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0/ips => generated 148 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:29:18.619208 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-ff14728a-0e3b-4e65-aa46-ff7c206c2242 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cde11675-7733-4496-ad78-69d06340f7e2"}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:29:18.621754 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-ff14728a-0e3b-4e65-aa46-ff7c206c2242 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:18.628610 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ff14728a-0e3b-4e65-aa46-ff7c206c2242 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:18.629108 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ff14728a-0e3b-4e65-aa46-ff7c206c2242 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:18.629991 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ff14728a-0e3b-4e65-aa46-ff7c206c2242 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:18.630716 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ff14728a-0e3b-4e65-aa46-ff7c206c2242 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:18.631180 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ff14728a-0e3b-4e65-aa46-ff7c206c2242 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:18.632204 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-ff14728a-0e3b-4e65-aa46-ff7c206c2242 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:19.508929 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-ff14728a-0e3b-4e65-aa46-ff7c206c2242 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "POST /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.894678 Sep 23 15:29:19.516115 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 489/978] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Sep 23 15:29:18 2022] POST /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0/os-volume_attachments => generated 194 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:29:27.217302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-935adcbd-4c46-41b2-bbb0-fe1ce32da852 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Action: 'create', calling method: .version_select at 0x7f82dbb27e50>, body: {"keypair": {"name": "tempest-keypair-529957231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPCeiJ1GC1flJ7Ct8bSO8GSZBI12VQl3blMU6JhY6rDcHyn1GNWZGI8b+VhKQXajZWGwy/CblyAeZMorr+7boZBKOTryhDHwWYzXGNe+EBUYg6vLKM6fLMPxONRgCcnIg=="}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:29:27.225862 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_api:SELECT=21 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:29:27.226843 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=49 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:29:27.241890 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-935adcbd-4c46-41b2-bbb0-fe1ce32da852 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Getting quotas for project 695b6a2a390b481bbca2fd367273c268. Resources: {'key_pairs'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:29:27.246982 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-935adcbd-4c46-41b2-bbb0-fe1ce32da852 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Getting quotas for user 97e06913feae4c23a9abbcd508f818d3 and project 695b6a2a390b481bbca2fd367273c268. Resources: {'key_pairs'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:29:27.343470 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-935adcbd-4c46-41b2-bbb0-fe1ce32da852 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.129614 Sep 23 15:29:27.344451 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 490/979] 10.222.0.55 () {60 vars in 1159 bytes} [Fri Sep 23 15:29:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:29:30.186581 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-98ac8bce-fd6d-4d47-a478-4e7893c49065 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-982991234", "imageRef": "051c4746-7f50-4edb-b09d-a8935df360de", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8efafa58-1ac7-4f82-bc57-6974c89b4f6e"}], "security_groups": [{"name": "tempest-securitygroup--839198289"}], "key_name": "tempest-keypair-529957231", "user_data": "}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:29:30.196761 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:29:30.197443 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:29:30.309297 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.network.neutron [None req-98ac8bce-fd6d-4d47-a478-4e7893c49065 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] validate_networks() for [('8efafa58-1ac7-4f82-bc57-6974c89b4f6e', None, None, None, None, None)] {{(pid=121448) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:29:30.758274 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-98ac8bce-fd6d-4d47-a478-4e7893c49065 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Flavor limits 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:29:30.758700 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-98ac8bce-fd6d-4d47-a478-4e7893c49065 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Image limits 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:29:30.759181 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-98ac8bce-fd6d-4d47-a478-4e7893c49065 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Flavor pref 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:29:30.759594 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-98ac8bce-fd6d-4d47-a478-4e7893c49065 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Image pref 0:0:0 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:29:30.760072 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.virt.hardware [None req-98ac8bce-fd6d-4d47-a478-4e7893c49065 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:29:30.771089 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-98ac8bce-fd6d-4d47-a478-4e7893c49065 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:30.772257 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-98ac8bce-fd6d-4d47-a478-4e7893c49065 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:30.773515 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-98ac8bce-fd6d-4d47-a478-4e7893c49065 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:30.774418 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-98ac8bce-fd6d-4d47-a478-4e7893c49065 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:30.775015 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-98ac8bce-fd6d-4d47-a478-4e7893c49065 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:30.775576 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-98ac8bce-fd6d-4d47-a478-4e7893c49065 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:30.799005 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-98ac8bce-fd6d-4d47-a478-4e7893c49065 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Getting quotas for project 695b6a2a390b481bbca2fd367273c268. Resources: {'ram', 'instances', 'cores'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:29:30.803138 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.quota [None req-98ac8bce-fd6d-4d47-a478-4e7893c49065 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Getting quotas for user 97e06913feae4c23a9abbcd508f818d3 and project 695b6a2a390b481bbca2fd367273c268. Resources: {'ram', 'instances', 'cores'} {{(pid=121448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:29:30.814844 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-98ac8bce-fd6d-4d47-a478-4e7893c49065 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Going to run 1 instances... {{(pid=121448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:29:30.817395 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-98ac8bce-fd6d-4d47-a478-4e7893c49065 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 8c0e8c64-53b0-4195-911d-a4e0444dc147] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='051c4746-7f50-4edb-b09d-a8935df360de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:29:31.014609 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-98ac8bce-fd6d-4d47-a478-4e7893c49065 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.832670 Sep 23 15:29:31.015547 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 490/980] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Sep 23 15:29:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:29:31.035484 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-e1731b97-b654-4dd9-84cf-0456207a3bd7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:31.036979 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-e1731b97-b654-4dd9-84cf-0456207a3bd7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 8c0e8c64-53b0-4195-911d-a4e0444dc147] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:31.110400 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-e1731b97-b654-4dd9-84cf-0456207a3bd7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:31.123727 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-e1731b97-b654-4dd9-84cf-0456207a3bd7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147" status: 200 len: 1240 microversion: 2.1 time: 0.095299 Sep 23 15:29:31.138307 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 491/981] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:31 2022] GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147 => generated 1240 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:32.153601 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-4837e1d5-5698-422c-b3b2-b28a33a7bf0b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:32.154954 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-4837e1d5-5698-422c-b3b2-b28a33a7bf0b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 8c0e8c64-53b0-4195-911d-a4e0444dc147] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:32.234295 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-4837e1d5-5698-422c-b3b2-b28a33a7bf0b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:32.249017 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-4837e1d5-5698-422c-b3b2-b28a33a7bf0b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147" status: 200 len: 1240 microversion: 2.1 time: 0.101156 Sep 23 15:29:32.264005 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 491/982] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:32 2022] GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147 => generated 1240 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:33.278609 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-3b2aa449-45e0-472f-864e-581e85f773f7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:33.279519 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-3b2aa449-45e0-472f-864e-581e85f773f7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 8c0e8c64-53b0-4195-911d-a4e0444dc147] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:33.288653 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3b2aa449-45e0-472f-864e-581e85f773f7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:33.289439 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3b2aa449-45e0-472f-864e-581e85f773f7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:33.290397 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3b2aa449-45e0-472f-864e-581e85f773f7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:33.291333 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3b2aa449-45e0-472f-864e-581e85f773f7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:33.291967 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3b2aa449-45e0-472f-864e-581e85f773f7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:33.292601 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3b2aa449-45e0-472f-864e-581e85f773f7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:33.394933 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-3b2aa449-45e0-472f-864e-581e85f773f7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:33.404394 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-3b2aa449-45e0-472f-864e-581e85f773f7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147" status: 200 len: 1292 microversion: 2.1 time: 0.132843 Sep 23 15:29:33.405252 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 492/983] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:33 2022] GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147 => generated 1292 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:34.435780 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-dd9912d4-476a-4ad6-a5d7-27f96396df5f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:34.436457 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-dd9912d4-476a-4ad6-a5d7-27f96396df5f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 8c0e8c64-53b0-4195-911d-a4e0444dc147] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:34.444936 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dd9912d4-476a-4ad6-a5d7-27f96396df5f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:34.445448 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dd9912d4-476a-4ad6-a5d7-27f96396df5f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:34.446131 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dd9912d4-476a-4ad6-a5d7-27f96396df5f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:34.447211 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dd9912d4-476a-4ad6-a5d7-27f96396df5f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:34.447846 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dd9912d4-476a-4ad6-a5d7-27f96396df5f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:34.452500 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dd9912d4-476a-4ad6-a5d7-27f96396df5f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:34.567072 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-dd9912d4-476a-4ad6-a5d7-27f96396df5f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:34.578029 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-dd9912d4-476a-4ad6-a5d7-27f96396df5f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147" status: 200 len: 1310 microversion: 2.1 time: 0.149530 Sep 23 15:29:34.578942 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 492/984] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:34 2022] GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147 => generated 1310 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:35.602815 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-adc5391c-05f9-4532-ac09-b6f5a22212a8 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:35.603556 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-adc5391c-05f9-4532-ac09-b6f5a22212a8 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 8c0e8c64-53b0-4195-911d-a4e0444dc147] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:35.610825 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-adc5391c-05f9-4532-ac09-b6f5a22212a8 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:35.611305 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-adc5391c-05f9-4532-ac09-b6f5a22212a8 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:35.611823 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-adc5391c-05f9-4532-ac09-b6f5a22212a8 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:35.612586 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-adc5391c-05f9-4532-ac09-b6f5a22212a8 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:35.613044 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-adc5391c-05f9-4532-ac09-b6f5a22212a8 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:35.613471 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-adc5391c-05f9-4532-ac09-b6f5a22212a8 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:35.671861 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-14eb05c3-f224-4eaa-bdbc-c575ac5a08a2 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:35.672507 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-14eb05c3-f224-4eaa-bdbc-c575ac5a08a2 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:35.680146 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-14eb05c3-f224-4eaa-bdbc-c575ac5a08a2 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:35.680648 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-14eb05c3-f224-4eaa-bdbc-c575ac5a08a2 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:35.681093 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-14eb05c3-f224-4eaa-bdbc-c575ac5a08a2 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:35.681855 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-14eb05c3-f224-4eaa-bdbc-c575ac5a08a2 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:35.682307 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-14eb05c3-f224-4eaa-bdbc-c575ac5a08a2 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:35.682738 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-14eb05c3-f224-4eaa-bdbc-c575ac5a08a2 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:35.709810 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-14eb05c3-f224-4eaa-bdbc-c575ac5a08a2 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Going to try to terminate instance {{(pid=121448) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:29:35.824753 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-adc5391c-05f9-4532-ac09-b6f5a22212a8 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:35.832830 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-adc5391c-05f9-4532-ac09-b6f5a22212a8 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147" status: 200 len: 1365 microversion: 2.1 time: 0.234515 Sep 23 15:29:35.833720 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 493/985] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:35 2022] GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147 => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:36.139690 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-14eb05c3-f224-4eaa-bdbc-c575ac5a08a2 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "DELETE /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 204 len: 0 microversion: 2.1 time: 0.471986 Sep 23 15:29:36.140618 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 493/986] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Sep 23 15:29:35 2022] DELETE /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 15:29:36.150566 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b562f4bc-5de6-4ccf-b79c-ac330f2541bb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:36.151216 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-b562f4bc-5de6-4ccf-b79c-ac330f2541bb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:36.157746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b562f4bc-5de6-4ccf-b79c-ac330f2541bb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:36.158160 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b562f4bc-5de6-4ccf-b79c-ac330f2541bb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:36.158560 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b562f4bc-5de6-4ccf-b79c-ac330f2541bb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:36.159269 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b562f4bc-5de6-4ccf-b79c-ac330f2541bb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:36.160601 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b562f4bc-5de6-4ccf-b79c-ac330f2541bb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:36.161189 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b562f4bc-5de6-4ccf-b79c-ac330f2541bb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:36.374718 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-b562f4bc-5de6-4ccf-b79c-ac330f2541bb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb120cee6bf4ef4b7da15735f5f77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86aa99c129b476980f17821cd30ef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:36.380495 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-b562f4bc-5de6-4ccf-b79c-ac330f2541bb tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 200 len: 1575 microversion: 2.1 time: 0.234756 Sep 23 15:29:36.381673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 494/987] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:36 2022] GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 1575 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:36.448191 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [req-1cb0a0d0-6067-4bfe-8c28-6c3d469f70b3 req-53be53d9-71d7-465f-b7dc-158ab6bbe9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c0e8c64-53b0-4195-911d-a4e0444dc147", "tag": "df586429-80a5-4a11-95e2-df3e07ddd59a"}]} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:29:36.458184 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-1cb0a0d0-6067-4bfe-8c28-6c3d469f70b3 req-53be53d9-71d7-465f-b7dc-158ab6bbe9c2 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:36.458667 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-1cb0a0d0-6067-4bfe-8c28-6c3d469f70b3 req-53be53d9-71d7-465f-b7dc-158ab6bbe9c2 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:36.462592 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [req-1cb0a0d0-6067-4bfe-8c28-6c3d469f70b3 req-53be53d9-71d7-465f-b7dc-158ab6bbe9c2 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:36.471757 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.compute.server_external_events [req-1cb0a0d0-6067-4bfe-8c28-6c3d469f70b3 req-53be53d9-71d7-465f-b7dc-158ab6bbe9c2 service nova] Creating event network-changed:df586429-80a5-4a11-95e2-df3e07ddd59a for instance 8c0e8c64-53b0-4195-911d-a4e0444dc147 on hv-cinder-85530 Sep 23 15:29:36.477372 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [req-1cb0a0d0-6067-4bfe-8c28-6c3d469f70b3 req-53be53d9-71d7-465f-b7dc-158ab6bbe9c2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033579 Sep 23 15:29:36.477807 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 494/988] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:29:36.856713 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-baae930c-1511-4443-92d2-952e77339027 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:36.857949 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-baae930c-1511-4443-92d2-952e77339027 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 8c0e8c64-53b0-4195-911d-a4e0444dc147] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:36.864999 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-baae930c-1511-4443-92d2-952e77339027 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:36.867036 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-baae930c-1511-4443-92d2-952e77339027 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:36.867632 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-baae930c-1511-4443-92d2-952e77339027 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:36.868237 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-baae930c-1511-4443-92d2-952e77339027 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:36.868702 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-baae930c-1511-4443-92d2-952e77339027 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:36.869130 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-baae930c-1511-4443-92d2-952e77339027 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:37.013873 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-baae930c-1511-4443-92d2-952e77339027 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:37.022065 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-baae930c-1511-4443-92d2-952e77339027 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147" status: 200 len: 1365 microversion: 2.1 time: 0.168928 Sep 23 15:29:37.022661 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 495/989] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:36 2022] GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:37.410574 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-96a85f37-2f14-463e-8dbf-3c915fd92755 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:37.411812 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-96a85f37-2f14-463e-8dbf-3c915fd92755 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:37.421243 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-96a85f37-2f14-463e-8dbf-3c915fd92755 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:37.421746 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-96a85f37-2f14-463e-8dbf-3c915fd92755 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:37.422193 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-96a85f37-2f14-463e-8dbf-3c915fd92755 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:37.422924 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-96a85f37-2f14-463e-8dbf-3c915fd92755 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:37.424173 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-96a85f37-2f14-463e-8dbf-3c915fd92755 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:37.424173 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-96a85f37-2f14-463e-8dbf-3c915fd92755 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:37.570967 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-96a85f37-2f14-463e-8dbf-3c915fd92755 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb120cee6bf4ef4b7da15735f5f77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86aa99c129b476980f17821cd30ef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:37.579212 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-96a85f37-2f14-463e-8dbf-3c915fd92755 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 200 len: 1575 microversion: 2.1 time: 0.177466 Sep 23 15:29:37.579788 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 495/990] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:37 2022] GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:29:38.046417 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-f1ff0bfa-478a-4bf8-b05c-cc201318c845 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:38.047177 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-f1ff0bfa-478a-4bf8-b05c-cc201318c845 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 8c0e8c64-53b0-4195-911d-a4e0444dc147] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:38.055351 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f1ff0bfa-478a-4bf8-b05c-cc201318c845 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:38.055938 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f1ff0bfa-478a-4bf8-b05c-cc201318c845 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:38.056566 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f1ff0bfa-478a-4bf8-b05c-cc201318c845 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:38.057381 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f1ff0bfa-478a-4bf8-b05c-cc201318c845 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:38.057911 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f1ff0bfa-478a-4bf8-b05c-cc201318c845 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:38.058342 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f1ff0bfa-478a-4bf8-b05c-cc201318c845 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:38.411624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-f1ff0bfa-478a-4bf8-b05c-cc201318c845 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:38.425788 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-f1ff0bfa-478a-4bf8-b05c-cc201318c845 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147" status: 200 len: 1365 microversion: 2.1 time: 0.383370 Sep 23 15:29:38.433090 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 496/991] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:38 2022] GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147 => generated 1365 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:38.604512 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-dbb41cad-2bdc-4f1b-9b41-9e0ef7382153 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:38.605172 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-dbb41cad-2bdc-4f1b-9b41-9e0ef7382153 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:38.611341 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dbb41cad-2bdc-4f1b-9b41-9e0ef7382153 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:38.616565 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dbb41cad-2bdc-4f1b-9b41-9e0ef7382153 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:38.616565 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dbb41cad-2bdc-4f1b-9b41-9e0ef7382153 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:38.616565 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dbb41cad-2bdc-4f1b-9b41-9e0ef7382153 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:38.616565 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dbb41cad-2bdc-4f1b-9b41-9e0ef7382153 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:38.617258 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-dbb41cad-2bdc-4f1b-9b41-9e0ef7382153 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:38.690453 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-dbb41cad-2bdc-4f1b-9b41-9e0ef7382153 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb120cee6bf4ef4b7da15735f5f77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86aa99c129b476980f17821cd30ef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:38.702871 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-dbb41cad-2bdc-4f1b-9b41-9e0ef7382153 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 200 len: 1507 microversion: 2.1 time: 0.101430 Sep 23 15:29:38.702871 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 496/992] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:38 2022] GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 1507 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:38.994157 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-573474a1-6d81-4c43-8202-7f11500cd2bf req-b9575745-e380-40dd-bc93-c276fe1d753d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ce91179-3e48-4016-881a-72a63aa9daf1", "name": "network-vif-deleted", "tag": "c2205af8-7e2a-495b-8ea9-4dccb9d37b61"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:29:39.004024 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-573474a1-6d81-4c43-8202-7f11500cd2bf req-b9575745-e380-40dd-bc93-c276fe1d753d service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:39.004707 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-573474a1-6d81-4c43-8202-7f11500cd2bf req-b9575745-e380-40dd-bc93-c276fe1d753d service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:39.005364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-573474a1-6d81-4c43-8202-7f11500cd2bf req-b9575745-e380-40dd-bc93-c276fe1d753d service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:39.020455 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-573474a1-6d81-4c43-8202-7f11500cd2bf req-b9575745-e380-40dd-bc93-c276fe1d753d service nova] Creating event network-vif-deleted:c2205af8-7e2a-495b-8ea9-4dccb9d37b61 for instance 8ce91179-3e48-4016-881a-72a63aa9daf1 on hv-cinder-85530 Sep 23 15:29:39.027122 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-573474a1-6d81-4c43-8202-7f11500cd2bf req-b9575745-e380-40dd-bc93-c276fe1d753d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038166 Sep 23 15:29:39.028079 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 497/993] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:29:39.456568 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-8508f101-7bdf-4548-bd34-9aa0db9f0cb1 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:39.457684 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-8508f101-7bdf-4548-bd34-9aa0db9f0cb1 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 8c0e8c64-53b0-4195-911d-a4e0444dc147] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:39.469440 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8508f101-7bdf-4548-bd34-9aa0db9f0cb1 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:39.470351 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8508f101-7bdf-4548-bd34-9aa0db9f0cb1 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:39.471160 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8508f101-7bdf-4548-bd34-9aa0db9f0cb1 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:39.472503 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8508f101-7bdf-4548-bd34-9aa0db9f0cb1 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:39.473692 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8508f101-7bdf-4548-bd34-9aa0db9f0cb1 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:39.474797 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-8508f101-7bdf-4548-bd34-9aa0db9f0cb1 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:39.683043 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-8508f101-7bdf-4548-bd34-9aa0db9f0cb1 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:39.692427 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-8508f101-7bdf-4548-bd34-9aa0db9f0cb1 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147" status: 200 len: 1365 microversion: 2.1 time: 0.245373 Sep 23 15:29:39.693847 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 497/994] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:39 2022] GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147 => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:39.726270 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-55668645-4a1a-4b6a-8957-9be1cab20758 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:39.727201 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-55668645-4a1a-4b6a-8957-9be1cab20758 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:39.734616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-55668645-4a1a-4b6a-8957-9be1cab20758 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:39.735154 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-55668645-4a1a-4b6a-8957-9be1cab20758 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:39.735591 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-55668645-4a1a-4b6a-8957-9be1cab20758 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:39.736356 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-55668645-4a1a-4b6a-8957-9be1cab20758 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:39.737043 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-55668645-4a1a-4b6a-8957-9be1cab20758 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:39.737754 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-55668645-4a1a-4b6a-8957-9be1cab20758 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:39.815556 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-55668645-4a1a-4b6a-8957-9be1cab20758 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb120cee6bf4ef4b7da15735f5f77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86aa99c129b476980f17821cd30ef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:39.823877 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-55668645-4a1a-4b6a-8957-9be1cab20758 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 200 len: 1224 microversion: 2.1 time: 0.102512 Sep 23 15:29:39.824489 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 498/995] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:39 2022] GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:40.716607 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-bc9532c1-4748-44fa-a8e8-bc76f29411a4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:40.717410 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.compute.api [None req-bc9532c1-4748-44fa-a8e8-bc76f29411a4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 8c0e8c64-53b0-4195-911d-a4e0444dc147] Fetching instance by UUID {{(pid=121448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:40.724323 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bc9532c1-4748-44fa-a8e8-bc76f29411a4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:40.725776 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bc9532c1-4748-44fa-a8e8-bc76f29411a4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:40.726394 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bc9532c1-4748-44fa-a8e8-bc76f29411a4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:40.727198 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bc9532c1-4748-44fa-a8e8-bc76f29411a4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:40.727671 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bc9532c1-4748-44fa-a8e8-bc76f29411a4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:40.728133 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG oslo_concurrency.lockutils [None req-bc9532c1-4748-44fa-a8e8-bc76f29411a4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:40.783598 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell0:SELECT=2 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:29:40.862203 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-92c7760a-9e5d-4a98-99e1-578dfc528df7 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:40.863234 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-92c7760a-9e5d-4a98-99e1-578dfc528df7 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:40.871955 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-92c7760a-9e5d-4a98-99e1-578dfc528df7 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:40.873053 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-92c7760a-9e5d-4a98-99e1-578dfc528df7 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:40.873673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-92c7760a-9e5d-4a98-99e1-578dfc528df7 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:40.874418 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-92c7760a-9e5d-4a98-99e1-578dfc528df7 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:40.875065 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-92c7760a-9e5d-4a98-99e1-578dfc528df7 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:40.875963 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-92c7760a-9e5d-4a98-99e1-578dfc528df7 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:40.879254 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.policy [None req-bc9532c1-4748-44fa-a8e8-bc76f29411a4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:40.897890 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO nova.api.openstack.requestlog [None req-bc9532c1-4748-44fa-a8e8-bc76f29411a4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147" status: 200 len: 1365 microversion: 2.1 time: 0.185174 Sep 23 15:29:40.899797 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: [pid: 121448|app: 0|req: 498/996] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:40 2022] GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:40.900711 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-92c7760a-9e5d-4a98-99e1-578dfc528df7 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] HTTP exception thrown: Instance 8ce91179-3e48-4016-881a-72a63aa9daf1 could not be found. Sep 23 15:29:40.902430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-92c7760a-9e5d-4a98-99e1-578dfc528df7 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Request method failure captured: Sep 23 15:29:40.902430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 HTTP/1.1 Sep 23 15:29:40.902430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:29:40.902430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:29:40.902430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:29:40.902430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:29:40.902430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:29:40.902430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:29:40.902430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:29:40.902430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:29:40.902430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLdAvFWc2RTqGJr4kde6zX-lVwLFvmw6tiaprusZbgT-HWxu88Ykj0Sx7s5ymYB-UJS4x__pUfFzGZ6DltQ1U8Scl_rCf8FDjWIxXbHsaWTzKLcus9UFDdM8O9mAX7QgJcm0II7zQL_w7VR9s1GsU5K3Nvl16h2nTVT7XpiPaXiM3Bps Sep 23 15:29:40.902430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:29:40.902430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:29:40.902430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:29:40.902430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:29:40.902430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:29:40.902430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:29:40.902430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: d86aa99c129b476980f17821cd30ef30 Sep 23 15:29:40.902430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-TestVolumeBootPattern-907521680 Sep 23 15:29:40.902430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:29:40.902430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:29:40.904230 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d86aa99c129b476980f17821cd30ef30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d86aa99c129b476980f17821cd30ef30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d86aa99c129b476980f17821cd30ef30", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d86aa99c129b476980f17821cd30ef30"}]}] Sep 23 15:29:40.904230 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-TestVolumeBootPattern-907521680 Sep 23 15:29:40.904230 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: d86aa99c129b476980f17821cd30ef30 Sep 23 15:29:40.904230 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-TestVolumeBootPattern-907521680 Sep 23 15:29:40.904230 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-TestVolumeBootPattern-907521680-project Sep 23 15:29:40.904230 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:29:40.904230 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:29:40.904230 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 1cb120cee6bf4ef4b7da15735f5f77e1 Sep 23 15:29:40.904230 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-TestVolumeBootPattern-907521680-project Sep 23 15:29:40.904230 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:29:40.904230 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance 8ce91179-3e48-4016-881a-72a63aa9daf1 could not be found. Sep 23 15:29:40.904230 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '8ce91179-3e48-4016-881a-72a63aa9daf1'} Sep 23 15:29:40.905469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:29:40.905469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:29:40.905469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:29:40.905469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:29:40.905469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:29:40.905469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:29:40.905469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:29:40.905469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:29:40.905469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:29:40.905469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:29:40.905469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ce91179-3e48-4016-881a-72a63aa9daf1 could not be found. Sep 23 15:29:40.905469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:29:40.905469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:29:40.905469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:29:40.905469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:29:40.905469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:29:40.905469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:29:40.905469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:29:40.905469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:29:40.905469 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:29:40.907182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:29:40.907182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:29:40.907182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:29:40.907182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:29:40.907182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:29:40.907182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:29:40.907182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:29:40.907182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ce91179-3e48-4016-881a-72a63aa9daf1 could not be found. Sep 23 15:29:40.907182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:29:40.907182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:29:40.907182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:29:40.907182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:29:40.907182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:29:40.907182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:29:40.907182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:29:40.907182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:29:40.907182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ce91179-3e48-4016-881a-72a63aa9daf1 could not be found. Sep 23 15:29:40.907182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:29:40.908626 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-92c7760a-9e5d-4a98-99e1-578dfc528df7 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Returning 404 to user: Instance 8ce91179-3e48-4016-881a-72a63aa9daf1 could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:29:40.908626 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-92c7760a-9e5d-4a98-99e1-578dfc528df7 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 404 len: 111 microversion: 2.1 time: 0.052021 Sep 23 15:29:40.908626 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 499/997] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:40 2022] GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 15:29:41.014130 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.api.openstack.wsgi [None req-f287afdc-55c8-4ce1-b77b-3d5c1831b33f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-46491497", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-40050967", "security_groups": [{"name": "tempest-secgroup-smoke-1508895721"}], "block_device_mapping_v2": [{"uuid": "902ee355-5a09-4fc0-8ed2-8f2ee1665340", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9072055c-d8f5-4479-88ef-7d0bad15cace"}]}} {{(pid=121448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:29:41.145651 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG nova.network.neutron [None req-f287afdc-55c8-4ce1-b77b-3d5c1831b33f tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] validate_networks() for [('9072055c-d8f5-4479-88ef-7d0bad15cace', None, None, None, None, None)] {{(pid=121448) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:29:41.932995 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-25386af7-774a-4293-97fa-711d382316f2 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:41.933862 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-25386af7-774a-4293-97fa-711d382316f2 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 8c0e8c64-53b0-4195-911d-a4e0444dc147] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:41.936053 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell0:SELECT=6 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:29:41.942517 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-25386af7-774a-4293-97fa-711d382316f2 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:41.943176 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-25386af7-774a-4293-97fa-711d382316f2 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:41.944315 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-25386af7-774a-4293-97fa-711d382316f2 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:41.944489 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-25386af7-774a-4293-97fa-711d382316f2 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:41.944871 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-25386af7-774a-4293-97fa-711d382316f2 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:41.945297 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-25386af7-774a-4293-97fa-711d382316f2 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:42.107423 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-25386af7-774a-4293-97fa-711d382316f2 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:42.116257 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-25386af7-774a-4293-97fa-711d382316f2 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147" status: 200 len: 1365 microversion: 2.1 time: 0.186735 Sep 23 15:29:42.117390 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 500/998] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:41 2022] GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147 => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:29:42.244553 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell0:SELECT=8 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:29:43.141041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b1c4b71f-fd4f-4e2d-8679-1b860e2bad7b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:43.141674 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-b1c4b71f-fd4f-4e2d-8679-1b860e2bad7b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 8c0e8c64-53b0-4195-911d-a4e0444dc147] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:43.147918 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b1c4b71f-fd4f-4e2d-8679-1b860e2bad7b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:43.148432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b1c4b71f-fd4f-4e2d-8679-1b860e2bad7b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:43.148873 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b1c4b71f-fd4f-4e2d-8679-1b860e2bad7b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:43.149577 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b1c4b71f-fd4f-4e2d-8679-1b860e2bad7b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:43.150028 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b1c4b71f-fd4f-4e2d-8679-1b860e2bad7b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:43.150451 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b1c4b71f-fd4f-4e2d-8679-1b860e2bad7b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:43.285264 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-b1c4b71f-fd4f-4e2d-8679-1b860e2bad7b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:43.293819 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-b1c4b71f-fd4f-4e2d-8679-1b860e2bad7b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147" status: 200 len: 1365 microversion: 2.1 time: 0.156728 Sep 23 15:29:43.294441 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 501/999] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:43 2022] GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:29:44.317669 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-619dd882-d4ef-4bb6-aa2a-156db8419ade tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:44.318599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-619dd882-d4ef-4bb6-aa2a-156db8419ade tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 8c0e8c64-53b0-4195-911d-a4e0444dc147] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:44.326115 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-619dd882-d4ef-4bb6-aa2a-156db8419ade tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:44.334737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-619dd882-d4ef-4bb6-aa2a-156db8419ade tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:44.334737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-619dd882-d4ef-4bb6-aa2a-156db8419ade tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:44.334737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-619dd882-d4ef-4bb6-aa2a-156db8419ade tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:44.334737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-619dd882-d4ef-4bb6-aa2a-156db8419ade tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:44.335341 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-619dd882-d4ef-4bb6-aa2a-156db8419ade tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:44.474092 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-619dd882-d4ef-4bb6-aa2a-156db8419ade tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:44.482103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-619dd882-d4ef-4bb6-aa2a-156db8419ade tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147" status: 200 len: 1365 microversion: 2.1 time: 0.168527 Sep 23 15:29:44.482794 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 502/1000] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:44 2022] GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:29:44.487700 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-afbc84e7-14ef-4798-8393-4937aa3764ab req-f6a83020-0cbe-4673-9685-5c66734a61d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c0e8c64-53b0-4195-911d-a4e0444dc147", "name": "network-vif-plugged", "status": "completed", "tag": "df586429-80a5-4a11-95e2-df3e07ddd59a"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:29:44.497577 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-afbc84e7-14ef-4798-8393-4937aa3764ab req-f6a83020-0cbe-4673-9685-5c66734a61d2 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:44.498060 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-afbc84e7-14ef-4798-8393-4937aa3764ab req-f6a83020-0cbe-4673-9685-5c66734a61d2 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:44.498487 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-afbc84e7-14ef-4798-8393-4937aa3764ab req-f6a83020-0cbe-4673-9685-5c66734a61d2 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:44.511443 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-afbc84e7-14ef-4798-8393-4937aa3764ab req-f6a83020-0cbe-4673-9685-5c66734a61d2 service nova] Creating event network-vif-plugged:df586429-80a5-4a11-95e2-df3e07ddd59a for instance 8c0e8c64-53b0-4195-911d-a4e0444dc147 on hv-cinder-85530 Sep 23 15:29:44.516737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-afbc84e7-14ef-4798-8393-4937aa3764ab req-f6a83020-0cbe-4673-9685-5c66734a61d2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032807 Sep 23 15:29:44.517341 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 503/1001] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:29:45.507078 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-8ffc0f6d-b21f-4f0f-9076-0a3e70e5a596 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:45.508346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-8ffc0f6d-b21f-4f0f-9076-0a3e70e5a596 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 8c0e8c64-53b0-4195-911d-a4e0444dc147] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:45.515084 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8ffc0f6d-b21f-4f0f-9076-0a3e70e5a596 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:45.515565 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8ffc0f6d-b21f-4f0f-9076-0a3e70e5a596 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:45.516026 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8ffc0f6d-b21f-4f0f-9076-0a3e70e5a596 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:45.516731 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8ffc0f6d-b21f-4f0f-9076-0a3e70e5a596 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:45.517179 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8ffc0f6d-b21f-4f0f-9076-0a3e70e5a596 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:45.517599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8ffc0f6d-b21f-4f0f-9076-0a3e70e5a596 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:45.654794 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-8ffc0f6d-b21f-4f0f-9076-0a3e70e5a596 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:45.663431 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-8ffc0f6d-b21f-4f0f-9076-0a3e70e5a596 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147" status: 200 len: 1365 microversion: 2.1 time: 0.160979 Sep 23 15:29:45.664022 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 504/1002] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:45 2022] GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:29:46.686137 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-3a5afecb-36da-4dca-9c0e-471bd3e4a594 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:46.686817 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-3a5afecb-36da-4dca-9c0e-471bd3e4a594 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 8c0e8c64-53b0-4195-911d-a4e0444dc147] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:46.693695 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3a5afecb-36da-4dca-9c0e-471bd3e4a594 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:46.694529 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3a5afecb-36da-4dca-9c0e-471bd3e4a594 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:46.694660 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3a5afecb-36da-4dca-9c0e-471bd3e4a594 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:46.695257 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3a5afecb-36da-4dca-9c0e-471bd3e4a594 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:46.695703 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3a5afecb-36da-4dca-9c0e-471bd3e4a594 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:46.696225 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3a5afecb-36da-4dca-9c0e-471bd3e4a594 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:46.836542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-3a5afecb-36da-4dca-9c0e-471bd3e4a594 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:46.846280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-3a5afecb-36da-4dca-9c0e-471bd3e4a594 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147" status: 200 len: 1554 microversion: 2.1 time: 0.163977 Sep 23 15:29:46.846857 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 505/1003] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:46 2022] GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:29:46.870912 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-4d04cf1b-9734-446e-b4f5-9d25b8141f94 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:46.871410 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-4d04cf1b-9734-446e-b4f5-9d25b8141f94 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 8c0e8c64-53b0-4195-911d-a4e0444dc147] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:46.877458 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4d04cf1b-9734-446e-b4f5-9d25b8141f94 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:46.877947 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4d04cf1b-9734-446e-b4f5-9d25b8141f94 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:46.878386 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4d04cf1b-9734-446e-b4f5-9d25b8141f94 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:46.879111 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4d04cf1b-9734-446e-b4f5-9d25b8141f94 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:46.879572 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4d04cf1b-9734-446e-b4f5-9d25b8141f94 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:46.880023 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4d04cf1b-9734-446e-b4f5-9d25b8141f94 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:46.961461 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-4d04cf1b-9734-446e-b4f5-9d25b8141f94 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094889 Sep 23 15:29:46.962104 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 506/1004] 10.222.0.55 () {58 vars in 1275 bytes} [Fri Sep 23 15:29:46 2022] GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:29:48.270230 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-20fa389a-e036-4679-8346-754aebf988ad req-1af8b8b2-19b6-40eb-93b7-9ae75185842f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c0e8c64-53b0-4195-911d-a4e0444dc147", "tag": "df586429-80a5-4a11-95e2-df3e07ddd59a"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:29:48.280708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-20fa389a-e036-4679-8346-754aebf988ad req-1af8b8b2-19b6-40eb-93b7-9ae75185842f service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:48.281182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-20fa389a-e036-4679-8346-754aebf988ad req-1af8b8b2-19b6-40eb-93b7-9ae75185842f service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:48.281612 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-20fa389a-e036-4679-8346-754aebf988ad req-1af8b8b2-19b6-40eb-93b7-9ae75185842f service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:48.302311 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-20fa389a-e036-4679-8346-754aebf988ad req-1af8b8b2-19b6-40eb-93b7-9ae75185842f service nova] Creating event network-changed:df586429-80a5-4a11-95e2-df3e07ddd59a for instance 8c0e8c64-53b0-4195-911d-a4e0444dc147 on hv-cinder-85530 Sep 23 15:29:48.308214 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-20fa389a-e036-4679-8346-754aebf988ad req-1af8b8b2-19b6-40eb-93b7-9ae75185842f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042540 Sep 23 15:29:48.308801 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 507/1005] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:29:50.884459 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:29:51.027174 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: DEBUG dbcounter [-] [121448] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:30:24.512371 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:30:24.516907 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=78 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:30:24.517465 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-4d1efe39-2d36-45a5-993e-6fa2c6c9b627 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:24.518051 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-4d1efe39-2d36-45a5-993e-6fa2c6c9b627 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 8c0e8c64-53b0-4195-911d-a4e0444dc147] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:24.528609 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4d1efe39-2d36-45a5-993e-6fa2c6c9b627 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:24.529497 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4d1efe39-2d36-45a5-993e-6fa2c6c9b627 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:24.530319 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4d1efe39-2d36-45a5-993e-6fa2c6c9b627 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:24.531608 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4d1efe39-2d36-45a5-993e-6fa2c6c9b627 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:24.532494 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4d1efe39-2d36-45a5-993e-6fa2c6c9b627 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:24.533284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4d1efe39-2d36-45a5-993e-6fa2c6c9b627 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:24.571407 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-4d1efe39-2d36-45a5-993e-6fa2c6c9b627 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147/ips" status: 200 len: 148 microversion: 2.1 time: 0.061076 Sep 23 15:30:24.572247 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 508/1006] 10.222.0.55 () {58 vars in 1248 bytes} [Fri Sep 23 15:30:24 2022] GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147/ips => generated 148 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:30:24.584714 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-1830ef83-f0bb-4c63-b8b1-271c611b20ba tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cde11675-7733-4496-ad78-69d06340f7e2"}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:30:24.587335 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-1830ef83-f0bb-4c63-b8b1-271c611b20ba tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 8c0e8c64-53b0-4195-911d-a4e0444dc147] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:24.593908 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1830ef83-f0bb-4c63-b8b1-271c611b20ba tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:24.594405 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1830ef83-f0bb-4c63-b8b1-271c611b20ba tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:24.594854 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1830ef83-f0bb-4c63-b8b1-271c611b20ba tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:24.595592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1830ef83-f0bb-4c63-b8b1-271c611b20ba tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:24.596080 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1830ef83-f0bb-4c63-b8b1-271c611b20ba tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:24.596519 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1830ef83-f0bb-4c63-b8b1-271c611b20ba tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:24.911513 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-1830ef83-f0bb-4c63-b8b1-271c611b20ba tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] HTTP exception thrown: Invalid volume: volume cde11675-7733-4496-ad78-69d06340f7e2 is already attached to instances: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 Sep 23 15:30:24.913492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-1830ef83-f0bb-4c63-b8b1-271c611b20ba tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Request method failure captured: Sep 23 15:30:24.913492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: POST /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147/os-volume_attachments HTTP/1.1 Sep 23 15:30:24.913492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:30:24.913492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:30:24.913492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:30:24.913492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 74 Sep 23 15:30:24.913492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:30:24.913492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:30:24.913492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:30:24.913492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:30:24.913492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLdCTXikAD57uZ4i3dSe4iywplg8jFFMGgew7gycP2RSgABkVXdIS1SCcQ0LMjtLpKwvlt669y2zWqhAdPefTh5DX__kK-BecMgkhXY17Yr2p9sKhzOx1ndN07Dq20ojAbxl7nPAtGJYV9vyJrlv0NpmeOM7YjuB8N-lsu2GRmY7Ga1s Sep 23 15:30:24.913492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:30:24.913492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:30:24.913492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:30:24.913492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:30:24.913492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:30:24.913492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:30:24.913492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:30:24.913492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:30:24.913492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:30:24.913492 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:30:24.915185 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_695b6a2a390b481bbca2fd367273c268", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}] Sep 23 15:30:24.915185 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:30:24.915185 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:30:24.915185 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:30:24.915185 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:30:24.915185 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:30:24.915185 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:30:24.915185 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 97e06913feae4c23a9abbcd508f818d3 Sep 23 15:30:24.915185 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:30:24.915185 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Sep 23 15:30:24.915185 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {"volumeAttachment": {"volumeId": "cde11675-7733-4496-ad78-69d06340f7e2"}} Sep 23 15:30:24.915185 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:30:24.916124 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Invalid volume: volume cde11675-7733-4496-ad78-69d06340f7e2 is already attached to instances: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 Sep 23 15:30:24.916124 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'server_id': '8c0e8c64-53b0-4195-911d-a4e0444dc147', 'body': {'volumeAttachment': {'volumeId': 'cde11675-7733-4496-ad78-69d06340f7e2'}}} Sep 23 15:30:24.916124 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:30:24.916124 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:30:24.916124 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 23 15:30:24.916124 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 23 15:30:24.916124 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 15:30:24.916124 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 15:30:24.916124 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 23 15:30:24.916124 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 15:30:24.916124 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 23 15:30:24.916124 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 23 15:30:24.916124 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 23 15:30:24.916124 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 23 15:30:24.916124 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cde11675-7733-4496-ad78-69d06340f7e2 is already attached to instances: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 Sep 23 15:30:24.916124 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:30:24.916124 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:30:24.916124 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:30:24.916124 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:30:24.917737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:30:24.917737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:30:24.917737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:30:24.917737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:30:24.917737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:30:24.917737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:30:24.917737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 15:30:24.917737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 15:30:24.917737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 15:30:24.917737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 15:30:24.917737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 15:30:24.917737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 15:30:24.917737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 23 15:30:24.917737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 23 15:30:24.917737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cde11675-7733-4496-ad78-69d06340f7e2 is already attached to instances: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 Sep 23 15:30:24.917737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:30:24.917737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:30:24.917737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:30:24.917737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:30:24.917737 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:30:24.919543 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:30:24.919543 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:30:24.919543 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:30:24.919543 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cde11675-7733-4496-ad78-69d06340f7e2 is already attached to instances: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 Sep 23 15:30:24.919543 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:30:24.919543 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-1830ef83-f0bb-4c63-b8b1-271c611b20ba tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Returning 400 to user: Invalid volume: volume cde11675-7733-4496-ad78-69d06340f7e2 is already attached to instances: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:30:24.919543 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-1830ef83-f0bb-4c63-b8b1-271c611b20ba tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "POST /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.335147 Sep 23 15:30:24.919543 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 509/1007] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Sep 23 15:30:24 2022] POST /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147/os-volume_attachments => generated 174 bytes in 336 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 23 15:30:24.927159 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-369464ba-f81c-416f-8e50-57c053223946 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:24.927664 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-369464ba-f81c-416f-8e50-57c053223946 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 8c0e8c64-53b0-4195-911d-a4e0444dc147] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:24.934949 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-369464ba-f81c-416f-8e50-57c053223946 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:24.935431 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-369464ba-f81c-416f-8e50-57c053223946 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:24.935926 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-369464ba-f81c-416f-8e50-57c053223946 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:24.936653 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-369464ba-f81c-416f-8e50-57c053223946 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:24.937097 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-369464ba-f81c-416f-8e50-57c053223946 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:24.937519 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-369464ba-f81c-416f-8e50-57c053223946 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:24.963240 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-369464ba-f81c-416f-8e50-57c053223946 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 8c0e8c64-53b0-4195-911d-a4e0444dc147] Going to try to terminate instance {{(pid=121450) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:30:25.305293 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-369464ba-f81c-416f-8e50-57c053223946 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "DELETE /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147" status: 204 len: 0 microversion: 2.1 time: 0.383820 Sep 23 15:30:25.306363 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 510/1008] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Sep 23 15:30:24 2022] DELETE /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:30:25.315559 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-d72c7899-9af3-4d87-89b1-dd608691973b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:25.316307 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-d72c7899-9af3-4d87-89b1-dd608691973b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 8c0e8c64-53b0-4195-911d-a4e0444dc147] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:25.331482 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d72c7899-9af3-4d87-89b1-dd608691973b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:25.334776 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d72c7899-9af3-4d87-89b1-dd608691973b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:25.334776 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d72c7899-9af3-4d87-89b1-dd608691973b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:25.334776 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d72c7899-9af3-4d87-89b1-dd608691973b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:25.334776 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d72c7899-9af3-4d87-89b1-dd608691973b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:25.335218 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d72c7899-9af3-4d87-89b1-dd608691973b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:25.487331 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-d72c7899-9af3-4d87-89b1-dd608691973b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:25.500540 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-d72c7899-9af3-4d87-89b1-dd608691973b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147" status: 200 len: 1678 microversion: 2.1 time: 0.188923 Sep 23 15:30:25.501245 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 511/1009] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:25 2022] GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147 => generated 1678 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:30:26.536800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-ca47a145-7aeb-47b2-aecd-e13487256b7e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:26.537760 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-ca47a145-7aeb-47b2-aecd-e13487256b7e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 8c0e8c64-53b0-4195-911d-a4e0444dc147] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:26.544247 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ca47a145-7aeb-47b2-aecd-e13487256b7e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:26.544735 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ca47a145-7aeb-47b2-aecd-e13487256b7e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:26.545170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ca47a145-7aeb-47b2-aecd-e13487256b7e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:26.545875 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ca47a145-7aeb-47b2-aecd-e13487256b7e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:26.546326 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ca47a145-7aeb-47b2-aecd-e13487256b7e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:26.546749 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ca47a145-7aeb-47b2-aecd-e13487256b7e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:26.839781 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-ca47a145-7aeb-47b2-aecd-e13487256b7e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:26.847791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-ca47a145-7aeb-47b2-aecd-e13487256b7e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147" status: 200 len: 1678 microversion: 2.1 time: 0.315656 Sep 23 15:30:26.849395 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 512/1010] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:26 2022] GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147 => generated 1678 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:30:27.776033 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-072d3b93-7030-4f37-8eef-cae7e8cf8042 req-94ae3ae4-4ec6-4337-93f1-19f54f8c8b4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c0e8c64-53b0-4195-911d-a4e0444dc147", "name": "network-vif-deleted", "tag": "df586429-80a5-4a11-95e2-df3e07ddd59a"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:30:27.788784 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-072d3b93-7030-4f37-8eef-cae7e8cf8042 req-94ae3ae4-4ec6-4337-93f1-19f54f8c8b4c service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:27.789280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-072d3b93-7030-4f37-8eef-cae7e8cf8042 req-94ae3ae4-4ec6-4337-93f1-19f54f8c8b4c service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:27.789751 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-072d3b93-7030-4f37-8eef-cae7e8cf8042 req-94ae3ae4-4ec6-4337-93f1-19f54f8c8b4c service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:27.802334 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-072d3b93-7030-4f37-8eef-cae7e8cf8042 req-94ae3ae4-4ec6-4337-93f1-19f54f8c8b4c service nova] Creating event network-vif-deleted:df586429-80a5-4a11-95e2-df3e07ddd59a for instance 8c0e8c64-53b0-4195-911d-a4e0444dc147 on hv-cinder-85530 Sep 23 15:30:27.807774 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-072d3b93-7030-4f37-8eef-cae7e8cf8042 req-94ae3ae4-4ec6-4337-93f1-19f54f8c8b4c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035876 Sep 23 15:30:27.808882 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 513/1011] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:30:27.876575 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-da6972d0-ead5-44af-bfb0-80fd6e905304 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:27.877725 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-da6972d0-ead5-44af-bfb0-80fd6e905304 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 8c0e8c64-53b0-4195-911d-a4e0444dc147] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:27.886185 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-da6972d0-ead5-44af-bfb0-80fd6e905304 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:27.887434 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-da6972d0-ead5-44af-bfb0-80fd6e905304 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:27.888282 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-da6972d0-ead5-44af-bfb0-80fd6e905304 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:27.889466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-da6972d0-ead5-44af-bfb0-80fd6e905304 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:27.890274 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-da6972d0-ead5-44af-bfb0-80fd6e905304 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:27.890941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-da6972d0-ead5-44af-bfb0-80fd6e905304 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:28.006550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-da6972d0-ead5-44af-bfb0-80fd6e905304 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:28.023683 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-da6972d0-ead5-44af-bfb0-80fd6e905304 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147" status: 200 len: 1611 microversion: 2.1 time: 0.152901 Sep 23 15:30:28.025466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 514/1012] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:27 2022] GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147 => generated 1611 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:29.060746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-42f282dd-faa5-46e0-929b-23f8037536ca tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:29.061704 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-42f282dd-faa5-46e0-929b-23f8037536ca tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 8c0e8c64-53b0-4195-911d-a4e0444dc147] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:29.076942 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-42f282dd-faa5-46e0-929b-23f8037536ca tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:29.077732 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-42f282dd-faa5-46e0-929b-23f8037536ca tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:29.078538 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-42f282dd-faa5-46e0-929b-23f8037536ca tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:29.079818 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-42f282dd-faa5-46e0-929b-23f8037536ca tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:29.080691 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-42f282dd-faa5-46e0-929b-23f8037536ca tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:29.081483 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-42f282dd-faa5-46e0-929b-23f8037536ca tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:29.106386 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-42f282dd-faa5-46e0-929b-23f8037536ca tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] HTTP exception thrown: Instance 8c0e8c64-53b0-4195-911d-a4e0444dc147 could not be found. Sep 23 15:30:29.108380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-42f282dd-faa5-46e0-929b-23f8037536ca tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Request method failure captured: Sep 23 15:30:29.108380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147 HTTP/1.1 Sep 23 15:30:29.108380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:30:29.108380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:30:29.108380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:30:29.108380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:30:29.108380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:30:29.108380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:30:29.108380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:30:29.108380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:30:29.108380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLdCTXikAD57uZ4i3dSe4iywplg8jFFMGgew7gycP2RSgABkVXdIS1SCcQ0LMjtLpKwvlt669y2zWqhAdPefTh5DX__kK-BecMgkhXY17Yr2p9sKhzOx1ndN07Dq20ojAbxl7nPAtGJYV9vyJrlv0NpmeOM7YjuB8N-lsu2GRmY7Ga1s Sep 23 15:30:29.108380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:30:29.108380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:30:29.108380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:30:29.108380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:30:29.108380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:30:29.108380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:30:29.108380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:30:29.108380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:30:29.108380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:30:29.108380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:30:29.110222 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_695b6a2a390b481bbca2fd367273c268", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}] Sep 23 15:30:29.110222 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:30:29.110222 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:30:29.110222 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:30:29.110222 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:30:29.110222 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:30:29.110222 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:30:29.110222 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 97e06913feae4c23a9abbcd508f818d3 Sep 23 15:30:29.110222 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:30:29.110222 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:30:29.110222 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance 8c0e8c64-53b0-4195-911d-a4e0444dc147 could not be found. Sep 23 15:30:29.110222 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '8c0e8c64-53b0-4195-911d-a4e0444dc147'} Sep 23 15:30:29.111167 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:30:29.111167 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:30:29.111167 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:30:29.111167 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:30:29.111167 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:30:29.111167 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:30:29.111167 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:30:29.111167 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:30:29.111167 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:30:29.111167 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:30:29.111167 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c0e8c64-53b0-4195-911d-a4e0444dc147 could not be found. Sep 23 15:30:29.111167 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:30:29.111167 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:30:29.111167 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:30:29.111167 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:30:29.111167 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:30:29.111167 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:30:29.111167 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:30:29.111167 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:30:29.111167 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:30:29.119624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:30:29.119624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:30:29.119624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:30:29.119624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:30:29.119624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:30:29.119624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:30:29.119624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:30:29.119624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c0e8c64-53b0-4195-911d-a4e0444dc147 could not be found. Sep 23 15:30:29.119624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:30:29.119624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:30:29.119624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:30:29.119624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:30:29.119624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:30:29.119624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:30:29.119624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:30:29.119624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:30:29.119624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c0e8c64-53b0-4195-911d-a4e0444dc147 could not be found. Sep 23 15:30:29.119624 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:30:29.122315 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-42f282dd-faa5-46e0-929b-23f8037536ca tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Returning 404 to user: Instance 8c0e8c64-53b0-4195-911d-a4e0444dc147 could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:30:29.122315 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-42f282dd-faa5-46e0-929b-23f8037536ca tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147" status: 404 len: 111 microversion: 2.1 time: 0.054363 Sep 23 15:30:29.122315 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 515/1013] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:29 2022] GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 15:30:29.122315 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a919a688-ec13-4e20-91ff-609d1d218427 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '.version_select at 0x7f82dbb273a0>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:29.208897 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-a919a688-ec13-4e20-91ff-609d1d218427 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-529957231" status: 202 len: 0 microversion: 2.1 time: 0.092975 Sep 23 15:30:29.209486 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 516/1014] 10.222.0.55 () {58 vars in 1218 bytes} [Fri Sep 23 15:30:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-529957231 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:30:30.182634 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-3eadf1cb-d78b-4e8a-845b-eb279ca7b5c4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:30.183312 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-3eadf1cb-d78b-4e8a-845b-eb279ca7b5c4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:30.190903 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3eadf1cb-d78b-4e8a-845b-eb279ca7b5c4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:30.191385 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3eadf1cb-d78b-4e8a-845b-eb279ca7b5c4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:30.192427 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3eadf1cb-d78b-4e8a-845b-eb279ca7b5c4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:30.193265 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3eadf1cb-d78b-4e8a-845b-eb279ca7b5c4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:30.193721 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3eadf1cb-d78b-4e8a-845b-eb279ca7b5c4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:30.194144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3eadf1cb-d78b-4e8a-845b-eb279ca7b5c4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:30.287081 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.objects.instance [None req-3eadf1cb-d78b-4e8a-845b-eb279ca7b5c4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lazy-loading 'services' on Instance uuid 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 {{(pid=121450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:30:30.584544 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-3eadf1cb-d78b-4e8a-845b-eb279ca7b5c4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "DELETE /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0/os-volume_attachments/cde11675-7733-4496-ad78-69d06340f7e2" status: 202 len: 0 microversion: 2.1 time: 0.407845 Sep 23 15:30:30.585063 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 517/1015] 10.222.0.55 () {58 vars in 1416 bytes} [Fri Sep 23 15:30:30 2022] DELETE /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0/os-volume_attachments/cde11675-7733-4496-ad78-69d06340f7e2 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 15:30:30.594187 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-ad026872-f38e-473f-b3f3-52d571a07648 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:30.596959 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-ad026872-f38e-473f-b3f3-52d571a07648 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:30.604973 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ad026872-f38e-473f-b3f3-52d571a07648 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:30.612283 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ad026872-f38e-473f-b3f3-52d571a07648 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:30.612283 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ad026872-f38e-473f-b3f3-52d571a07648 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:30.612283 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ad026872-f38e-473f-b3f3-52d571a07648 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:30.612283 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ad026872-f38e-473f-b3f3-52d571a07648 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:30.612710 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ad026872-f38e-473f-b3f3-52d571a07648 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:30.641477 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-ad026872-f38e-473f-b3f3-52d571a07648 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051554 Sep 23 15:30:30.642054 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 518/1016] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Sep 23 15:30:30 2022] GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:30:31.655495 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-acd09fa5-4c23-4e4d-9819-0b86b2060b83 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:31.658002 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-acd09fa5-4c23-4e4d-9819-0b86b2060b83 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:31.666293 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-acd09fa5-4c23-4e4d-9819-0b86b2060b83 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:31.666786 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-acd09fa5-4c23-4e4d-9819-0b86b2060b83 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:31.667234 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-acd09fa5-4c23-4e4d-9819-0b86b2060b83 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:31.667936 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-acd09fa5-4c23-4e4d-9819-0b86b2060b83 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:31.668430 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-acd09fa5-4c23-4e4d-9819-0b86b2060b83 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:31.668859 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-acd09fa5-4c23-4e4d-9819-0b86b2060b83 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:31.705501 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-acd09fa5-4c23-4e4d-9819-0b86b2060b83 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054262 Sep 23 15:30:31.706095 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 519/1017] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Sep 23 15:30:31 2022] GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:30:32.720720 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-761e79dc-8498-4c8b-917e-a5c88fdbb262 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:32.724585 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-761e79dc-8498-4c8b-917e-a5c88fdbb262 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:32.732882 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-761e79dc-8498-4c8b-917e-a5c88fdbb262 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:32.733721 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-761e79dc-8498-4c8b-917e-a5c88fdbb262 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:32.734472 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-761e79dc-8498-4c8b-917e-a5c88fdbb262 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:32.735630 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-761e79dc-8498-4c8b-917e-a5c88fdbb262 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:32.736438 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-761e79dc-8498-4c8b-917e-a5c88fdbb262 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:32.736953 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-761e79dc-8498-4c8b-917e-a5c88fdbb262 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:32.779215 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-761e79dc-8498-4c8b-917e-a5c88fdbb262 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063608 Sep 23 15:30:32.780129 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 520/1018] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Sep 23 15:30:32 2022] GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 15:30:32.885265 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-040c7d21-ffc2-4467-9768-fac03bda6c6d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:32.885767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-040c7d21-ffc2-4467-9768-fac03bda6c6d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:32.893252 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-040c7d21-ffc2-4467-9768-fac03bda6c6d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:32.893739 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-040c7d21-ffc2-4467-9768-fac03bda6c6d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:32.894172 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-040c7d21-ffc2-4467-9768-fac03bda6c6d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:32.895514 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-040c7d21-ffc2-4467-9768-fac03bda6c6d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:32.896220 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-040c7d21-ffc2-4467-9768-fac03bda6c6d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:32.896651 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-040c7d21-ffc2-4467-9768-fac03bda6c6d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:32.940716 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-040c7d21-ffc2-4467-9768-fac03bda6c6d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Going to try to terminate instance {{(pid=121450) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:30:33.357221 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-040c7d21-ffc2-4467-9768-fac03bda6c6d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "DELETE /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0" status: 204 len: 0 microversion: 2.1 time: 0.466031 Sep 23 15:30:33.357221 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 521/1019] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Sep 23 15:30:32 2022] DELETE /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 15:30:33.358059 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b3f7834b-0d91-46c9-90dd-f1d950001f92 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:33.358753 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-b3f7834b-0d91-46c9-90dd-f1d950001f92 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:33.367565 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b3f7834b-0d91-46c9-90dd-f1d950001f92 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:33.368172 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b3f7834b-0d91-46c9-90dd-f1d950001f92 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:33.368671 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b3f7834b-0d91-46c9-90dd-f1d950001f92 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:33.369447 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b3f7834b-0d91-46c9-90dd-f1d950001f92 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:33.369958 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b3f7834b-0d91-46c9-90dd-f1d950001f92 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:33.370381 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b3f7834b-0d91-46c9-90dd-f1d950001f92 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:33.553525 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-b3f7834b-0d91-46c9-90dd-f1d950001f92 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:33.563621 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-b3f7834b-0d91-46c9-90dd-f1d950001f92 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0" status: 200 len: 1678 microversion: 2.1 time: 0.210014 Sep 23 15:30:33.564274 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 522/1020] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:33 2022] GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 => generated 1678 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:30:34.588505 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-42dbbc18-0ef3-4fbc-a8cd-c02619fef974 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:34.589450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-42dbbc18-0ef3-4fbc-a8cd-c02619fef974 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:34.599241 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-42dbbc18-0ef3-4fbc-a8cd-c02619fef974 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:34.599739 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-42dbbc18-0ef3-4fbc-a8cd-c02619fef974 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:34.600279 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-42dbbc18-0ef3-4fbc-a8cd-c02619fef974 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:34.601013 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-42dbbc18-0ef3-4fbc-a8cd-c02619fef974 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:34.601471 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-42dbbc18-0ef3-4fbc-a8cd-c02619fef974 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:34.601903 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-42dbbc18-0ef3-4fbc-a8cd-c02619fef974 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:34.606807 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:30:34.805913 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-42dbbc18-0ef3-4fbc-a8cd-c02619fef974 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:34.815418 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-42dbbc18-0ef3-4fbc-a8cd-c02619fef974 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0" status: 200 len: 1678 microversion: 2.1 time: 0.231020 Sep 23 15:30:34.816249 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 523/1021] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:34 2022] GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 => generated 1678 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:30:35.843773 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-47df0ba5-53b5-466c-82e1-9e76acf976b4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:35.844840 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-47df0ba5-53b5-466c-82e1-9e76acf976b4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:35.853755 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-47df0ba5-53b5-466c-82e1-9e76acf976b4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:35.854599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-47df0ba5-53b5-466c-82e1-9e76acf976b4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:35.855072 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-47df0ba5-53b5-466c-82e1-9e76acf976b4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:35.855957 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-47df0ba5-53b5-466c-82e1-9e76acf976b4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:35.856355 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-47df0ba5-53b5-466c-82e1-9e76acf976b4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:35.856871 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-47df0ba5-53b5-466c-82e1-9e76acf976b4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:35.947128 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-47df0ba5-53b5-466c-82e1-9e76acf976b4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:35.959254 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-47df0ba5-53b5-466c-82e1-9e76acf976b4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0" status: 200 len: 1611 microversion: 2.1 time: 0.121614 Sep 23 15:30:35.960721 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 524/1022] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:35 2022] GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 => generated 1611 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:30:36.373064 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-a95fb14a-d90d-4bc1-ba53-b4c406aac029 req-bc12060e-4bb8-4b36-8110-ee9cb7fa8326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0", "name": "network-vif-deleted", "tag": "69f1e0fd-61ab-460b-ba4e-c5d2bd2846d6"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:30:36.386416 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-a95fb14a-d90d-4bc1-ba53-b4c406aac029 req-bc12060e-4bb8-4b36-8110-ee9cb7fa8326 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:36.391235 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-a95fb14a-d90d-4bc1-ba53-b4c406aac029 req-bc12060e-4bb8-4b36-8110-ee9cb7fa8326 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:36.391235 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-a95fb14a-d90d-4bc1-ba53-b4c406aac029 req-bc12060e-4bb8-4b36-8110-ee9cb7fa8326 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:36.403378 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-a95fb14a-d90d-4bc1-ba53-b4c406aac029 req-bc12060e-4bb8-4b36-8110-ee9cb7fa8326 service nova] Creating event network-vif-deleted:69f1e0fd-61ab-460b-ba4e-c5d2bd2846d6 for instance 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 on hv-cinder-85530 Sep 23 15:30:36.409132 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-a95fb14a-d90d-4bc1-ba53-b4c406aac029 req-bc12060e-4bb8-4b36-8110-ee9cb7fa8326 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039915 Sep 23 15:30:36.409747 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 525/1023] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:30:37.009070 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a6223016-3ce7-457c-b1ba-388978a69686 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:37.013092 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-a6223016-3ce7-457c-b1ba-388978a69686 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:37.025663 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a6223016-3ce7-457c-b1ba-388978a69686 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:37.026782 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a6223016-3ce7-457c-b1ba-388978a69686 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:37.027816 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a6223016-3ce7-457c-b1ba-388978a69686 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:37.029744 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a6223016-3ce7-457c-b1ba-388978a69686 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:37.030636 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a6223016-3ce7-457c-b1ba-388978a69686 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:37.031793 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a6223016-3ce7-457c-b1ba-388978a69686 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:37.115853 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a6223016-3ce7-457c-b1ba-388978a69686 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:37.117212 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a6223016-3ce7-457c-b1ba-388978a69686 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:37.118336 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a6223016-3ce7-457c-b1ba-388978a69686 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:37.119135 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.objects.instance [None req-a6223016-3ce7-457c-b1ba-388978a69686 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lazy-loading 'fault' on Instance uuid 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 {{(pid=121450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:30:37.190424 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a6223016-3ce7-457c-b1ba-388978a69686 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:37.203806 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-a6223016-3ce7-457c-b1ba-388978a69686 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0" status: 200 len: 1330 microversion: 2.1 time: 0.209463 Sep 23 15:30:37.207157 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 526/1024] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:36 2022] GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 => generated 1330 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:38.236023 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-ec71bc17-d8c0-4c2d-ba92-2fa627c27d9f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:38.237504 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-ec71bc17-d8c0-4c2d-ba92-2fa627c27d9f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:38.245159 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ec71bc17-d8c0-4c2d-ba92-2fa627c27d9f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:38.245660 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ec71bc17-d8c0-4c2d-ba92-2fa627c27d9f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:38.246103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ec71bc17-d8c0-4c2d-ba92-2fa627c27d9f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:38.246829 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ec71bc17-d8c0-4c2d-ba92-2fa627c27d9f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:38.247291 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ec71bc17-d8c0-4c2d-ba92-2fa627c27d9f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:38.247718 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ec71bc17-d8c0-4c2d-ba92-2fa627c27d9f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:38.263787 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-ec71bc17-d8c0-4c2d-ba92-2fa627c27d9f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] HTTP exception thrown: Instance 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 could not be found. Sep 23 15:30:38.265562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-ec71bc17-d8c0-4c2d-ba92-2fa627c27d9f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Request method failure captured: Sep 23 15:30:38.265562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 HTTP/1.1 Sep 23 15:30:38.265562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:30:38.265562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:30:38.265562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:30:38.265562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:30:38.265562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:30:38.265562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:30:38.265562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:30:38.265562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:30:38.265562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLdCTXikAD57uZ4i3dSe4iywplg8jFFMGgew7gycP2RSgABkVXdIS1SCcQ0LMjtLpKwvlt669y2zWqhAdPefTh5DX__kK-BecMgkhXY17Yr2p9sKhzOx1ndN07Dq20ojAbxl7nPAtGJYV9vyJrlv0NpmeOM7YjuB8N-lsu2GRmY7Ga1s Sep 23 15:30:38.265562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:30:38.265562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:30:38.265562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:30:38.265562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:30:38.265562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:30:38.265562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:30:38.265562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:30:38.265562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:30:38.265562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:30:38.265562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:30:38.273325 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_695b6a2a390b481bbca2fd367273c268", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}] Sep 23 15:30:38.273325 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:30:38.273325 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:30:38.273325 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:30:38.273325 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:30:38.273325 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:30:38.273325 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:30:38.273325 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 97e06913feae4c23a9abbcd508f818d3 Sep 23 15:30:38.273325 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:30:38.273325 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:30:38.273325 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 could not be found. Sep 23 15:30:38.273325 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0'} Sep 23 15:30:38.274934 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:30:38.274934 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:30:38.274934 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:30:38.274934 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:30:38.274934 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:30:38.274934 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:30:38.274934 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:30:38.274934 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:30:38.274934 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:30:38.274934 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:30:38.274934 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 could not be found. Sep 23 15:30:38.274934 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:30:38.274934 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:30:38.274934 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:30:38.274934 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:30:38.274934 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:30:38.274934 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:30:38.274934 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:30:38.274934 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:30:38.274934 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:30:38.277616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:30:38.277616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:30:38.277616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:30:38.277616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:30:38.277616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:30:38.277616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:30:38.277616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:30:38.277616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 could not be found. Sep 23 15:30:38.277616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:30:38.277616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:30:38.277616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:30:38.277616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:30:38.277616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:30:38.277616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:30:38.277616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:30:38.277616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:30:38.277616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 could not be found. Sep 23 15:30:38.277616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:30:38.280933 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-ec71bc17-d8c0-4c2d-ba92-2fa627c27d9f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Returning 404 to user: Instance 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:30:38.280933 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-ec71bc17-d8c0-4c2d-ba92-2fa627c27d9f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0" status: 404 len: 111 microversion: 2.1 time: 0.035650 Sep 23 15:30:38.280933 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 527/1025] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:38 2022] GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 15:30:38.280933 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-e1561c40-1c7a-43dc-bc5b-52318a7a6f73 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '.version_select at 0x7f82dbbacb80>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:38.457597 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-e1561c40-1c7a-43dc-bc5b-52318a7a6f73 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-791437157" status: 202 len: 0 microversion: 2.1 time: 0.182641 Sep 23 15:30:38.458765 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 528/1026] 10.222.0.55 () {58 vars in 1218 bytes} [Fri Sep 23 15:30:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-791437157 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 15:30:39.582946 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-6938e30f-1cdc-4ace-b0b2-821c8e569bda tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Action: 'create', calling method: .version_select at 0x7f82dbeea790>, body: {"keypair": {"name": "tempest-keypair-1328957183", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIL6gOjBla1xe0Auk8kRJGnYIyRD9F0WsHbt6IhvGAQpEpl/TDOCIewG+Pmw7fWF0zPxgFmtLuUkttdM5Ru0NjadtAAIcomT2Ik1iiUdalhuqevxKGQKhZ8FHZ1B2i8vA=="}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:30:39.600939 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-6938e30f-1cdc-4ace-b0b2-821c8e569bda tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Getting quotas for project 695b6a2a390b481bbca2fd367273c268. Resources: {'key_pairs'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:30:39.605818 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-6938e30f-1cdc-4ace-b0b2-821c8e569bda tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Getting quotas for user 97e06913feae4c23a9abbcd508f818d3 and project 695b6a2a390b481bbca2fd367273c268. Resources: {'key_pairs'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:30:39.757296 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-6938e30f-1cdc-4ace-b0b2-821c8e569bda tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.181800 Sep 23 15:30:39.757906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 529/1027] 10.222.0.55 () {60 vars in 1159 bytes} [Fri Sep 23 15:30:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:30:41.980495 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-d35b1e3a-06ff-4739-ab63-4ba3d916bd14 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:41.981156 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-d35b1e3a-06ff-4739-ab63-4ba3d916bd14 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:41.987582 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d35b1e3a-06ff-4739-ab63-4ba3d916bd14 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:41.988570 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d35b1e3a-06ff-4739-ab63-4ba3d916bd14 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:41.989024 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d35b1e3a-06ff-4739-ab63-4ba3d916bd14 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:41.989816 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d35b1e3a-06ff-4739-ab63-4ba3d916bd14 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:41.990534 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d35b1e3a-06ff-4739-ab63-4ba3d916bd14 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:41.990968 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d35b1e3a-06ff-4739-ab63-4ba3d916bd14 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:42.006047 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-d35b1e3a-06ff-4739-ab63-4ba3d916bd14 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] HTTP exception thrown: Instance 8ce91179-3e48-4016-881a-72a63aa9daf1 could not be found. Sep 23 15:30:42.007673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-d35b1e3a-06ff-4739-ab63-4ba3d916bd14 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Request method failure captured: Sep 23 15:30:42.007673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: DELETE /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 HTTP/1.1 Sep 23 15:30:42.007673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:30:42.007673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:30:42.007673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:30:42.007673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:30:42.007673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:30:42.007673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:30:42.007673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:30:42.007673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:30:42.007673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLdAvFWc2RTqGJr4kde6zX-lVwLFvmw6tiaprusZbgT-HWxu88Ykj0Sx7s5ymYB-UJS4x__pUfFzGZ6DltQ1U8Scl_rCf8FDjWIxXbHsaWTzKLcus9UFDdM8O9mAX7QgJcm0II7zQL_w7VR9s1GsU5K3Nvl16h2nTVT7XpiPaXiM3Bps Sep 23 15:30:42.007673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:30:42.007673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:30:42.007673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:30:42.007673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:30:42.007673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:30:42.007673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:30:42.007673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: d86aa99c129b476980f17821cd30ef30 Sep 23 15:30:42.007673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-TestVolumeBootPattern-907521680 Sep 23 15:30:42.007673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:30:42.007673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:30:42.010221 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d86aa99c129b476980f17821cd30ef30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d86aa99c129b476980f17821cd30ef30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d86aa99c129b476980f17821cd30ef30", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d86aa99c129b476980f17821cd30ef30"}]}] Sep 23 15:30:42.010221 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-TestVolumeBootPattern-907521680 Sep 23 15:30:42.010221 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: d86aa99c129b476980f17821cd30ef30 Sep 23 15:30:42.010221 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-TestVolumeBootPattern-907521680 Sep 23 15:30:42.010221 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-TestVolumeBootPattern-907521680-project Sep 23 15:30:42.010221 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:30:42.010221 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:30:42.010221 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 1cb120cee6bf4ef4b7da15735f5f77e1 Sep 23 15:30:42.010221 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-TestVolumeBootPattern-907521680-project Sep 23 15:30:42.010221 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:30:42.010221 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance 8ce91179-3e48-4016-881a-72a63aa9daf1 could not be found. Sep 23 15:30:42.010221 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '8ce91179-3e48-4016-881a-72a63aa9daf1'} Sep 23 15:30:42.011867 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:30:42.011867 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:30:42.011867 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:30:42.011867 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:30:42.011867 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:30:42.011867 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:30:42.011867 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:30:42.011867 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:30:42.011867 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:30:42.011867 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:30:42.011867 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ce91179-3e48-4016-881a-72a63aa9daf1 could not be found. Sep 23 15:30:42.011867 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:30:42.011867 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:30:42.011867 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:30:42.011867 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:30:42.011867 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:30:42.011867 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:30:42.011867 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:30:42.011867 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:30:42.011867 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:30:42.020070 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:30:42.020070 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 15:30:42.020070 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 15:30:42.020070 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 15:30:42.020070 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 15:30:42.020070 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:30:42.020070 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:30:42.020070 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:30:42.020070 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:30:42.020070 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ce91179-3e48-4016-881a-72a63aa9daf1 could not be found. Sep 23 15:30:42.020070 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:30:42.020070 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:30:42.020070 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:30:42.020070 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:30:42.020070 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:30:42.020070 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:30:42.020070 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:30:42.020070 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:30:42.020070 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ce91179-3e48-4016-881a-72a63aa9daf1 could not be found. Sep 23 15:30:42.020070 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:30:42.023507 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-d35b1e3a-06ff-4739-ab63-4ba3d916bd14 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Returning 404 to user: Instance 8ce91179-3e48-4016-881a-72a63aa9daf1 could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:30:42.023507 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-d35b1e3a-06ff-4739-ab63-4ba3d916bd14 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "DELETE /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 404 len: 111 microversion: 2.1 time: 0.033597 Sep 23 15:30:42.023507 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 530/1028] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Sep 23 15:30:41 2022] DELETE /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 15:30:42.028115 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-afe3b2cb-eae8-4e16-99f4-0a7f7d8dd758 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:42.028921 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-afe3b2cb-eae8-4e16-99f4-0a7f7d8dd758 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] [instance: 8ce91179-3e48-4016-881a-72a63aa9daf1] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:42.036346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-afe3b2cb-eae8-4e16-99f4-0a7f7d8dd758 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:42.036880 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-afe3b2cb-eae8-4e16-99f4-0a7f7d8dd758 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:42.037331 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-afe3b2cb-eae8-4e16-99f4-0a7f7d8dd758 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:42.038056 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-afe3b2cb-eae8-4e16-99f4-0a7f7d8dd758 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:42.038513 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-afe3b2cb-eae8-4e16-99f4-0a7f7d8dd758 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:42.038940 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-afe3b2cb-eae8-4e16-99f4-0a7f7d8dd758 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:42.056397 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-afe3b2cb-eae8-4e16-99f4-0a7f7d8dd758 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] HTTP exception thrown: Instance 8ce91179-3e48-4016-881a-72a63aa9daf1 could not be found. Sep 23 15:30:42.057981 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-afe3b2cb-eae8-4e16-99f4-0a7f7d8dd758 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Request method failure captured: Sep 23 15:30:42.057981 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 HTTP/1.1 Sep 23 15:30:42.057981 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:30:42.057981 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:30:42.057981 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:30:42.057981 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:30:42.057981 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:30:42.057981 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:30:42.057981 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:30:42.057981 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:30:42.057981 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLdAvFWc2RTqGJr4kde6zX-lVwLFvmw6tiaprusZbgT-HWxu88Ykj0Sx7s5ymYB-UJS4x__pUfFzGZ6DltQ1U8Scl_rCf8FDjWIxXbHsaWTzKLcus9UFDdM8O9mAX7QgJcm0II7zQL_w7VR9s1GsU5K3Nvl16h2nTVT7XpiPaXiM3Bps Sep 23 15:30:42.057981 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:30:42.057981 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:30:42.057981 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:30:42.057981 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:30:42.057981 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:30:42.057981 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:30:42.057981 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: d86aa99c129b476980f17821cd30ef30 Sep 23 15:30:42.057981 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-TestVolumeBootPattern-907521680 Sep 23 15:30:42.057981 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:30:42.057981 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:30:42.059561 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d86aa99c129b476980f17821cd30ef30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d86aa99c129b476980f17821cd30ef30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d86aa99c129b476980f17821cd30ef30", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d86aa99c129b476980f17821cd30ef30"}]}] Sep 23 15:30:42.059561 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-TestVolumeBootPattern-907521680 Sep 23 15:30:42.059561 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: d86aa99c129b476980f17821cd30ef30 Sep 23 15:30:42.059561 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-TestVolumeBootPattern-907521680 Sep 23 15:30:42.059561 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-TestVolumeBootPattern-907521680-project Sep 23 15:30:42.059561 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:30:42.059561 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:30:42.059561 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 1cb120cee6bf4ef4b7da15735f5f77e1 Sep 23 15:30:42.059561 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-TestVolumeBootPattern-907521680-project Sep 23 15:30:42.059561 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:30:42.059561 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance 8ce91179-3e48-4016-881a-72a63aa9daf1 could not be found. Sep 23 15:30:42.059561 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '8ce91179-3e48-4016-881a-72a63aa9daf1'} Sep 23 15:30:42.060425 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:30:42.060425 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:30:42.060425 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:30:42.060425 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:30:42.060425 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:30:42.060425 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:30:42.060425 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:30:42.060425 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:30:42.060425 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:30:42.060425 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:30:42.060425 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ce91179-3e48-4016-881a-72a63aa9daf1 could not be found. Sep 23 15:30:42.060425 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:30:42.060425 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:30:42.060425 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:30:42.060425 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:30:42.060425 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:30:42.060425 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:30:42.060425 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:30:42.060425 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:30:42.060425 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:30:42.061905 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:30:42.061905 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:30:42.061905 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:30:42.061905 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:30:42.061905 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:30:42.061905 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:30:42.061905 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:30:42.061905 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ce91179-3e48-4016-881a-72a63aa9daf1 could not be found. Sep 23 15:30:42.061905 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:30:42.061905 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:30:42.061905 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:30:42.061905 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:30:42.061905 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:30:42.061905 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:30:42.061905 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:30:42.061905 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:30:42.061905 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ce91179-3e48-4016-881a-72a63aa9daf1 could not be found. Sep 23 15:30:42.061905 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:30:42.063118 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-afe3b2cb-eae8-4e16-99f4-0a7f7d8dd758 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Returning 404 to user: Instance 8ce91179-3e48-4016-881a-72a63aa9daf1 could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:30:42.063118 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-afe3b2cb-eae8-4e16-99f4-0a7f7d8dd758 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1" status: 404 len: 111 microversion: 2.1 time: 0.036556 Sep 23 15:30:42.063118 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 531/1029] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:42 2022] GET /compute/v2.1/servers/8ce91179-3e48-4016-881a-72a63aa9daf1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:30:42.929578 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-08680751-489a-4ac1-a1a6-64cb69b4311a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1554961077", "imageRef": "051c4746-7f50-4edb-b09d-a8935df360de", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8efafa58-1ac7-4f82-bc57-6974c89b4f6e"}], "security_groups": [{"name": "tempest-securitygroup--1909462538"}], "key_name": "tempest-keypair-1328957183", "user_data": "}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:30:43.058197 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.network.neutron [None req-08680751-489a-4ac1-a1a6-64cb69b4311a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] validate_networks() for [('8efafa58-1ac7-4f82-bc57-6974c89b4f6e', None, None, None, None, None)] {{(pid=121450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:30:43.490428 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-08680751-489a-4ac1-a1a6-64cb69b4311a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Flavor limits 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:30:43.491103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-08680751-489a-4ac1-a1a6-64cb69b4311a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Image limits 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:30:43.491883 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-08680751-489a-4ac1-a1a6-64cb69b4311a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Flavor pref 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:30:43.492667 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-08680751-489a-4ac1-a1a6-64cb69b4311a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Image pref 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:30:43.493308 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-08680751-489a-4ac1-a1a6-64cb69b4311a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:30:43.508515 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-08680751-489a-4ac1-a1a6-64cb69b4311a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:43.513341 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-08680751-489a-4ac1-a1a6-64cb69b4311a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:43.513341 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-08680751-489a-4ac1-a1a6-64cb69b4311a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:43.513341 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-08680751-489a-4ac1-a1a6-64cb69b4311a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:43.513341 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-08680751-489a-4ac1-a1a6-64cb69b4311a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:43.514391 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-08680751-489a-4ac1-a1a6-64cb69b4311a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:43.535073 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-08680751-489a-4ac1-a1a6-64cb69b4311a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Getting quotas for project 695b6a2a390b481bbca2fd367273c268. Resources: {'ram', 'instances', 'cores'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:30:43.540830 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-08680751-489a-4ac1-a1a6-64cb69b4311a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Getting quotas for user 97e06913feae4c23a9abbcd508f818d3 and project 695b6a2a390b481bbca2fd367273c268. Resources: {'ram', 'instances', 'cores'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:30:43.557269 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-08680751-489a-4ac1-a1a6-64cb69b4311a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Going to run 1 instances... {{(pid=121450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:30:43.560272 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-08680751-489a-4ac1-a1a6-64cb69b4311a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='051c4746-7f50-4edb-b09d-a8935df360de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:30:43.718839 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-08680751-489a-4ac1-a1a6-64cb69b4311a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.795227 Sep 23 15:30:43.719603 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 532/1030] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Sep 23 15:30:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 15:30:43.740714 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-4f780138-4740-44ca-b1e4-9e79fc4b71b3 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:43.741774 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-4f780138-4740-44ca-b1e4-9e79fc4b71b3 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:43.813174 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-4f780138-4740-44ca-b1e4-9e79fc4b71b3 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:43.826083 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-4f780138-4740-44ca-b1e4-9e79fc4b71b3 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d" status: 200 len: 1242 microversion: 2.1 time: 0.093350 Sep 23 15:30:43.826918 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 533/1031] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:43 2022] GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d => generated 1242 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:43.863863 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-7e019222-f8b1-4180-964d-3f1c5999c069 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] Calling method '.version_select at 0x7f82dbb63940>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:43.878849 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:30:44.105188 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-7e019222-f8b1-4180-964d-3f1c5999c069 tempest-TestVolumeBootPattern-907521680 tempest-TestVolumeBootPattern-907521680-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-40050967" status: 202 len: 0 microversion: 2.1 time: 0.250270 Sep 23 15:30:44.106458 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 534/1032] 10.222.0.55 () {58 vars in 1257 bytes} [Fri Sep 23 15:30:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-40050967 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:30:44.864025 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-f8080cc8-aa44-4bcd-9f96-001da682aa00 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:44.864832 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-f8080cc8-aa44-4bcd-9f96-001da682aa00 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:44.939225 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-f8080cc8-aa44-4bcd-9f96-001da682aa00 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:44.949700 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-f8080cc8-aa44-4bcd-9f96-001da682aa00 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d" status: 200 len: 1242 microversion: 2.1 time: 0.092507 Sep 23 15:30:44.950485 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 535/1033] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:44 2022] GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d => generated 1242 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:45.983059 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-ffbf98a2-9886-475f-b5da-d40d069dd76c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:45.984027 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-ffbf98a2-9886-475f-b5da-d40d069dd76c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:45.994698 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ffbf98a2-9886-475f-b5da-d40d069dd76c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:45.995422 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ffbf98a2-9886-475f-b5da-d40d069dd76c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:45.996133 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ffbf98a2-9886-475f-b5da-d40d069dd76c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:45.996945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ffbf98a2-9886-475f-b5da-d40d069dd76c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:45.997512 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ffbf98a2-9886-475f-b5da-d40d069dd76c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:45.998107 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ffbf98a2-9886-475f-b5da-d40d069dd76c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:46.118555 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-ffbf98a2-9886-475f-b5da-d40d069dd76c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:46.133776 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-ffbf98a2-9886-475f-b5da-d40d069dd76c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d" status: 200 len: 1294 microversion: 2.1 time: 0.157255 Sep 23 15:30:46.134616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 536/1034] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:45 2022] GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d => generated 1294 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:47.161728 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-10f1f14f-f696-4bc7-ba9c-b8701c4d1706 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:47.162395 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-10f1f14f-f696-4bc7-ba9c-b8701c4d1706 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:47.169103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-10f1f14f-f696-4bc7-ba9c-b8701c4d1706 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:47.169584 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-10f1f14f-f696-4bc7-ba9c-b8701c4d1706 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:47.170020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-10f1f14f-f696-4bc7-ba9c-b8701c4d1706 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:47.170729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-10f1f14f-f696-4bc7-ba9c-b8701c4d1706 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:47.171178 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-10f1f14f-f696-4bc7-ba9c-b8701c4d1706 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:47.171607 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-10f1f14f-f696-4bc7-ba9c-b8701c4d1706 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:47.262886 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-10f1f14f-f696-4bc7-ba9c-b8701c4d1706 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:47.272026 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-10f1f14f-f696-4bc7-ba9c-b8701c4d1706 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d" status: 200 len: 1300 microversion: 2.1 time: 0.115486 Sep 23 15:30:47.272690 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 537/1035] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:47 2022] GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d => generated 1300 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:30:48.298374 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-6d75e6ef-e542-46e2-8b2a-229bc3e0098d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:48.298374 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-6d75e6ef-e542-46e2-8b2a-229bc3e0098d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:48.308299 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6d75e6ef-e542-46e2-8b2a-229bc3e0098d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:48.308801 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6d75e6ef-e542-46e2-8b2a-229bc3e0098d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:48.309334 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6d75e6ef-e542-46e2-8b2a-229bc3e0098d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:48.310075 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6d75e6ef-e542-46e2-8b2a-229bc3e0098d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:48.310536 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6d75e6ef-e542-46e2-8b2a-229bc3e0098d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:48.311260 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6d75e6ef-e542-46e2-8b2a-229bc3e0098d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:48.600436 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-6d75e6ef-e542-46e2-8b2a-229bc3e0098d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:48.612778 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-6d75e6ef-e542-46e2-8b2a-229bc3e0098d tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d" status: 200 len: 1368 microversion: 2.1 time: 0.319639 Sep 23 15:30:48.614775 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 538/1036] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:48 2022] GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d => generated 1368 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:30:49.703584 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-d9f4d181-f491-4163-b657-3b8e05d3dfe5 req-32f8732b-a92b-40c9-8c1f-533c2e208ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "493750db-5539-47c2-a9ef-5cbf489b295d", "tag": "19d0ee19-e224-46c7-b495-29b93b0f2d29"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:30:49.715058 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-d9f4d181-f491-4163-b657-3b8e05d3dfe5 req-32f8732b-a92b-40c9-8c1f-533c2e208ac1 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:49.715666 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-d9f4d181-f491-4163-b657-3b8e05d3dfe5 req-32f8732b-a92b-40c9-8c1f-533c2e208ac1 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:49.716247 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-d9f4d181-f491-4163-b657-3b8e05d3dfe5 req-32f8732b-a92b-40c9-8c1f-533c2e208ac1 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:49.730285 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-d9f4d181-f491-4163-b657-3b8e05d3dfe5 req-32f8732b-a92b-40c9-8c1f-533c2e208ac1 service nova] Creating event network-changed:19d0ee19-e224-46c7-b495-29b93b0f2d29 for instance 493750db-5539-47c2-a9ef-5cbf489b295d on hv-cinder-85530 Sep 23 15:30:49.735749 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-d9f4d181-f491-4163-b657-3b8e05d3dfe5 req-32f8732b-a92b-40c9-8c1f-533c2e208ac1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107226 Sep 23 15:30:49.736646 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 539/1037] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:30:49.742504 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-43e79912-e365-4b68-be3d-19dd90363638 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:49.743827 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-43e79912-e365-4b68-be3d-19dd90363638 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:49.750431 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-43e79912-e365-4b68-be3d-19dd90363638 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:49.750916 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-43e79912-e365-4b68-be3d-19dd90363638 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:49.751351 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-43e79912-e365-4b68-be3d-19dd90363638 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:49.752168 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-43e79912-e365-4b68-be3d-19dd90363638 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:49.752769 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-43e79912-e365-4b68-be3d-19dd90363638 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:49.753036 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-43e79912-e365-4b68-be3d-19dd90363638 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:50.347536 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-43e79912-e365-4b68-be3d-19dd90363638 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:50.356700 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-43e79912-e365-4b68-be3d-19dd90363638 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d" status: 200 len: 1368 microversion: 2.1 time: 0.618999 Sep 23 15:30:50.357283 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 540/1038] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:49 2022] GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d => generated 1368 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:51.382081 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-48659816-b028-4cc2-b84c-15b2483df729 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:51.382985 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-48659816-b028-4cc2-b84c-15b2483df729 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:51.389661 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-48659816-b028-4cc2-b84c-15b2483df729 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:51.390156 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-48659816-b028-4cc2-b84c-15b2483df729 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:51.390589 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-48659816-b028-4cc2-b84c-15b2483df729 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:51.391667 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-48659816-b028-4cc2-b84c-15b2483df729 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:51.392170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-48659816-b028-4cc2-b84c-15b2483df729 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:51.392600 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-48659816-b028-4cc2-b84c-15b2483df729 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:51.654945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-48659816-b028-4cc2-b84c-15b2483df729 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:51.664032 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-48659816-b028-4cc2-b84c-15b2483df729 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d" status: 200 len: 1368 microversion: 2.1 time: 0.286445 Sep 23 15:30:51.664758 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 541/1039] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:51 2022] GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d => generated 1368 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:52.687504 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-0f415a9d-3aae-4420-8da2-0fa8ed39018c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:52.688304 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-0f415a9d-3aae-4420-8da2-0fa8ed39018c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:52.695283 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0f415a9d-3aae-4420-8da2-0fa8ed39018c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:52.695785 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0f415a9d-3aae-4420-8da2-0fa8ed39018c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:52.696252 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0f415a9d-3aae-4420-8da2-0fa8ed39018c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:52.696976 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0f415a9d-3aae-4420-8da2-0fa8ed39018c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:52.697433 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0f415a9d-3aae-4420-8da2-0fa8ed39018c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:52.697860 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0f415a9d-3aae-4420-8da2-0fa8ed39018c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:52.845422 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-0f415a9d-3aae-4420-8da2-0fa8ed39018c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:52.853772 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-0f415a9d-3aae-4420-8da2-0fa8ed39018c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d" status: 200 len: 1368 microversion: 2.1 time: 0.170743 Sep 23 15:30:52.854455 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 542/1040] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:52 2022] GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:30:53.882343 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-c4e74ac0-c566-4a93-bf45-404a7ec6d986 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:53.883082 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-c4e74ac0-c566-4a93-bf45-404a7ec6d986 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:53.885038 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell0:SELECT=2 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:30:53.891952 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c4e74ac0-c566-4a93-bf45-404a7ec6d986 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:53.891952 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c4e74ac0-c566-4a93-bf45-404a7ec6d986 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:53.892569 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c4e74ac0-c566-4a93-bf45-404a7ec6d986 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:53.895483 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c4e74ac0-c566-4a93-bf45-404a7ec6d986 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:53.896242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c4e74ac0-c566-4a93-bf45-404a7ec6d986 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:53.896735 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c4e74ac0-c566-4a93-bf45-404a7ec6d986 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:54.089887 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-c4e74ac0-c566-4a93-bf45-404a7ec6d986 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:54.097719 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-c4e74ac0-c566-4a93-bf45-404a7ec6d986 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d" status: 200 len: 1368 microversion: 2.1 time: 0.220352 Sep 23 15:30:54.098304 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 543/1041] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:53 2022] GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:30:55.122183 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-4fabb9d7-bb8f-41ea-a6f5-6d415906b740 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:55.129086 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-4fabb9d7-bb8f-41ea-a6f5-6d415906b740 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:55.129086 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell0:SELECT=14 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:30:55.130577 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4fabb9d7-bb8f-41ea-a6f5-6d415906b740 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:55.131069 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4fabb9d7-bb8f-41ea-a6f5-6d415906b740 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:55.131504 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4fabb9d7-bb8f-41ea-a6f5-6d415906b740 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:55.132224 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4fabb9d7-bb8f-41ea-a6f5-6d415906b740 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:55.132675 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4fabb9d7-bb8f-41ea-a6f5-6d415906b740 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:55.133093 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4fabb9d7-bb8f-41ea-a6f5-6d415906b740 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:55.281063 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-4fabb9d7-bb8f-41ea-a6f5-6d415906b740 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:55.289145 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-4fabb9d7-bb8f-41ea-a6f5-6d415906b740 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d" status: 200 len: 1368 microversion: 2.1 time: 0.171265 Sep 23 15:30:55.289854 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 544/1042] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:55 2022] GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:56.313203 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a2516c8d-5879-4da9-accb-8268dd4e86e0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:56.314118 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-a2516c8d-5879-4da9-accb-8268dd4e86e0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:56.321729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a2516c8d-5879-4da9-accb-8268dd4e86e0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:56.322228 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a2516c8d-5879-4da9-accb-8268dd4e86e0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:56.322671 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a2516c8d-5879-4da9-accb-8268dd4e86e0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:56.323374 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a2516c8d-5879-4da9-accb-8268dd4e86e0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:56.323819 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a2516c8d-5879-4da9-accb-8268dd4e86e0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:56.324283 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a2516c8d-5879-4da9-accb-8268dd4e86e0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:56.501629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a2516c8d-5879-4da9-accb-8268dd4e86e0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:56.510450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-a2516c8d-5879-4da9-accb-8268dd4e86e0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d" status: 200 len: 1368 microversion: 2.1 time: 0.200959 Sep 23 15:30:56.510942 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 545/1043] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:56 2022] GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d => generated 1368 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:30:56.612847 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-bb70a038-7bd2-4078-89df-662140295102 req-9628f52a-0fb2-4136-b820-6a8adef7d1d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "493750db-5539-47c2-a9ef-5cbf489b295d", "name": "network-vif-plugged", "status": "completed", "tag": "19d0ee19-e224-46c7-b495-29b93b0f2d29"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:30:56.622170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-bb70a038-7bd2-4078-89df-662140295102 req-9628f52a-0fb2-4136-b820-6a8adef7d1d1 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:56.622645 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-bb70a038-7bd2-4078-89df-662140295102 req-9628f52a-0fb2-4136-b820-6a8adef7d1d1 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:56.623066 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-bb70a038-7bd2-4078-89df-662140295102 req-9628f52a-0fb2-4136-b820-6a8adef7d1d1 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:56.634646 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-bb70a038-7bd2-4078-89df-662140295102 req-9628f52a-0fb2-4136-b820-6a8adef7d1d1 service nova] Creating event network-vif-plugged:19d0ee19-e224-46c7-b495-29b93b0f2d29 for instance 493750db-5539-47c2-a9ef-5cbf489b295d on hv-cinder-85530 Sep 23 15:30:56.639843 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-bb70a038-7bd2-4078-89df-662140295102 req-9628f52a-0fb2-4136-b820-6a8adef7d1d1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032004 Sep 23 15:30:56.643886 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 546/1044] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:30:57.536442 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-9433c2b9-d215-4da1-9394-ee968ce93032 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:57.537177 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-9433c2b9-d215-4da1-9394-ee968ce93032 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:57.543880 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9433c2b9-d215-4da1-9394-ee968ce93032 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:57.548403 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9433c2b9-d215-4da1-9394-ee968ce93032 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:57.548403 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9433c2b9-d215-4da1-9394-ee968ce93032 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:57.548403 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9433c2b9-d215-4da1-9394-ee968ce93032 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:57.548403 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9433c2b9-d215-4da1-9394-ee968ce93032 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:57.548774 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9433c2b9-d215-4da1-9394-ee968ce93032 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:57.682327 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-9433c2b9-d215-4da1-9394-ee968ce93032 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:57.690535 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-9433c2b9-d215-4da1-9394-ee968ce93032 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d" status: 200 len: 1368 microversion: 2.1 time: 0.159455 Sep 23 15:30:57.691745 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 547/1045] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:57 2022] GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:30:58.713899 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-8c475455-045a-4487-93d8-d3a83b5f3a9e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:58.714615 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-8c475455-045a-4487-93d8-d3a83b5f3a9e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:58.721035 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c475455-045a-4487-93d8-d3a83b5f3a9e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:58.722608 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c475455-045a-4487-93d8-d3a83b5f3a9e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:58.722608 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c475455-045a-4487-93d8-d3a83b5f3a9e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:58.723136 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c475455-045a-4487-93d8-d3a83b5f3a9e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:58.723589 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c475455-045a-4487-93d8-d3a83b5f3a9e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:58.724040 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8c475455-045a-4487-93d8-d3a83b5f3a9e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:58.855247 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-8c475455-045a-4487-93d8-d3a83b5f3a9e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:58.864078 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-8c475455-045a-4487-93d8-d3a83b5f3a9e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d" status: 200 len: 1557 microversion: 2.1 time: 0.153992 Sep 23 15:30:58.864664 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 548/1046] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:58 2022] GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:30:58.886198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-ae6df610-09c5-45d8-be06-9f03d021d8d7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:58.886693 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-ae6df610-09c5-45d8-be06-9f03d021d8d7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:58.892590 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ae6df610-09c5-45d8-be06-9f03d021d8d7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:58.893071 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ae6df610-09c5-45d8-be06-9f03d021d8d7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:58.893507 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ae6df610-09c5-45d8-be06-9f03d021d8d7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:58.894226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ae6df610-09c5-45d8-be06-9f03d021d8d7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:58.894872 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ae6df610-09c5-45d8-be06-9f03d021d8d7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:58.895200 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ae6df610-09c5-45d8-be06-9f03d021d8d7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:58.899125 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=100 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:30:58.980009 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-ae6df610-09c5-45d8-be06-9f03d021d8d7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097516 Sep 23 15:30:58.980620 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 549/1047] 10.222.0.55 () {58 vars in 1275 bytes} [Fri Sep 23 15:30:58 2022] GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:31:00.022328 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-aa44e0d1-1ce8-4f74-b2a9-1425295af47a req-2791e9ac-8e89-4df9-aa31-15b31cf3e536 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "493750db-5539-47c2-a9ef-5cbf489b295d", "tag": "19d0ee19-e224-46c7-b495-29b93b0f2d29"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:31:00.031683 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-aa44e0d1-1ce8-4f74-b2a9-1425295af47a req-2791e9ac-8e89-4df9-aa31-15b31cf3e536 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:00.032196 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-aa44e0d1-1ce8-4f74-b2a9-1425295af47a req-2791e9ac-8e89-4df9-aa31-15b31cf3e536 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:00.032631 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-aa44e0d1-1ce8-4f74-b2a9-1425295af47a req-2791e9ac-8e89-4df9-aa31-15b31cf3e536 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:00.044419 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-aa44e0d1-1ce8-4f74-b2a9-1425295af47a req-2791e9ac-8e89-4df9-aa31-15b31cf3e536 service nova] Creating event network-changed:19d0ee19-e224-46c7-b495-29b93b0f2d29 for instance 493750db-5539-47c2-a9ef-5cbf489b295d on hv-cinder-85530 Sep 23 15:31:00.049402 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-aa44e0d1-1ce8-4f74-b2a9-1425295af47a req-2791e9ac-8e89-4df9-aa31-15b31cf3e536 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031370 Sep 23 15:31:00.050528 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 550/1048] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:31:32.485297 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:32.486034 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=4 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:32.491055 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-2e937a27-117b-45f7-b282-0fc03ffd0ba0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:32.491627 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-2e937a27-117b-45f7-b282-0fc03ffd0ba0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:32.497688 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2e937a27-117b-45f7-b282-0fc03ffd0ba0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:32.505572 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2e937a27-117b-45f7-b282-0fc03ffd0ba0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:32.505572 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2e937a27-117b-45f7-b282-0fc03ffd0ba0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:32.505572 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2e937a27-117b-45f7-b282-0fc03ffd0ba0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:32.505572 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2e937a27-117b-45f7-b282-0fc03ffd0ba0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:32.506002 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2e937a27-117b-45f7-b282-0fc03ffd0ba0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:32.523370 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-2e937a27-117b-45f7-b282-0fc03ffd0ba0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d/ips" status: 200 len: 149 microversion: 2.1 time: 0.039820 Sep 23 15:31:32.524154 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 551/1049] 10.222.0.55 () {58 vars in 1248 bytes} [Fri Sep 23 15:31:32 2022] GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:31:34.170894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a4375b34-3559-4fde-9271-eb9d036662e0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f860894-9bec-4b4e-955a-9f5db96dc1b7"}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:31:34.173281 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-a4375b34-3559-4fde-9271-eb9d036662e0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:34.180563 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a4375b34-3559-4fde-9271-eb9d036662e0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:34.181045 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a4375b34-3559-4fde-9271-eb9d036662e0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:34.181476 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a4375b34-3559-4fde-9271-eb9d036662e0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:34.182180 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a4375b34-3559-4fde-9271-eb9d036662e0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:34.182647 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a4375b34-3559-4fde-9271-eb9d036662e0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:34.183055 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a4375b34-3559-4fde-9271-eb9d036662e0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:34.967155 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-a4375b34-3559-4fde-9271-eb9d036662e0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "POST /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.800752 Sep 23 15:31:34.967771 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 552/1050] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Sep 23 15:31:34 2022] POST /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d/os-volume_attachments => generated 194 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:31:42.547798 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-56cb408b-3bd1-4a22-888c-38d4b4a1c7f6 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f860894-9bec-4b4e-955a-9f5db96dc1b7"}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:31:42.550907 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-56cb408b-3bd1-4a22-888c-38d4b4a1c7f6 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:42.557242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-56cb408b-3bd1-4a22-888c-38d4b4a1c7f6 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:42.557727 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-56cb408b-3bd1-4a22-888c-38d4b4a1c7f6 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:42.558158 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-56cb408b-3bd1-4a22-888c-38d4b4a1c7f6 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:42.558854 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-56cb408b-3bd1-4a22-888c-38d4b4a1c7f6 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:42.559301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-56cb408b-3bd1-4a22-888c-38d4b4a1c7f6 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:42.559721 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-56cb408b-3bd1-4a22-888c-38d4b4a1c7f6 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:42.640815 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-56cb408b-3bd1-4a22-888c-38d4b4a1c7f6 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] HTTP exception thrown: Invalid volume: volume 4f860894-9bec-4b4e-955a-9f5db96dc1b7 is already attached to instances: 493750db-5539-47c2-a9ef-5cbf489b295d Sep 23 15:31:42.642522 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-56cb408b-3bd1-4a22-888c-38d4b4a1c7f6 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Request method failure captured: Sep 23 15:31:42.642522 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: POST /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d/os-volume_attachments HTTP/1.1 Sep 23 15:31:42.642522 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:31:42.642522 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:31:42.642522 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:31:42.642522 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 74 Sep 23 15:31:42.642522 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:31:42.642522 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:31:42.642522 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:31:42.642522 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:31:42.642522 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLdCTXikAD57uZ4i3dSe4iywplg8jFFMGgew7gycP2RSgABkVXdIS1SCcQ0LMjtLpKwvlt669y2zWqhAdPefTh5DX__kK-BecMgkhXY17Yr2p9sKhzOx1ndN07Dq20ojAbxl7nPAtGJYV9vyJrlv0NpmeOM7YjuB8N-lsu2GRmY7Ga1s Sep 23 15:31:42.642522 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:31:42.642522 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:31:42.642522 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:31:42.642522 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:31:42.642522 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:31:42.642522 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:31:42.642522 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:31:42.642522 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:31:42.642522 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:31:42.642522 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:31:42.644154 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_695b6a2a390b481bbca2fd367273c268", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}] Sep 23 15:31:42.644154 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:31:42.644154 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:31:42.644154 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:31:42.644154 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:31:42.644154 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:31:42.644154 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:31:42.644154 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 97e06913feae4c23a9abbcd508f818d3 Sep 23 15:31:42.644154 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:31:42.644154 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Sep 23 15:31:42.644154 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {"volumeAttachment": {"volumeId": "4f860894-9bec-4b4e-955a-9f5db96dc1b7"}} Sep 23 15:31:42.644154 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:31:42.645003 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Invalid volume: volume 4f860894-9bec-4b4e-955a-9f5db96dc1b7 is already attached to instances: 493750db-5539-47c2-a9ef-5cbf489b295d Sep 23 15:31:42.645003 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'server_id': '493750db-5539-47c2-a9ef-5cbf489b295d', 'body': {'volumeAttachment': {'volumeId': '4f860894-9bec-4b4e-955a-9f5db96dc1b7'}}} Sep 23 15:31:42.645003 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:31:42.645003 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:31:42.645003 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 23 15:31:42.645003 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 23 15:31:42.645003 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 15:31:42.645003 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 15:31:42.645003 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 23 15:31:42.645003 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 15:31:42.645003 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 23 15:31:42.645003 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 23 15:31:42.645003 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 23 15:31:42.645003 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 23 15:31:42.645003 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4f860894-9bec-4b4e-955a-9f5db96dc1b7 is already attached to instances: 493750db-5539-47c2-a9ef-5cbf489b295d Sep 23 15:31:42.645003 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:31:42.645003 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:31:42.645003 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:31:42.645003 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:31:42.646477 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:31:42.646477 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:31:42.646477 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:31:42.646477 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:31:42.646477 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:31:42.646477 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:31:42.646477 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 15:31:42.646477 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 15:31:42.646477 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 15:31:42.646477 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 15:31:42.646477 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 15:31:42.646477 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 15:31:42.646477 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 23 15:31:42.646477 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 23 15:31:42.646477 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4f860894-9bec-4b4e-955a-9f5db96dc1b7 is already attached to instances: 493750db-5539-47c2-a9ef-5cbf489b295d Sep 23 15:31:42.646477 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:31:42.646477 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:31:42.646477 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:31:42.646477 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:31:42.646477 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:31:42.648143 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:31:42.648143 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:31:42.648143 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:31:42.648143 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4f860894-9bec-4b4e-955a-9f5db96dc1b7 is already attached to instances: 493750db-5539-47c2-a9ef-5cbf489b295d Sep 23 15:31:42.648143 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:31:42.648143 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-56cb408b-3bd1-4a22-888c-38d4b4a1c7f6 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Returning 400 to user: Invalid volume: volume 4f860894-9bec-4b4e-955a-9f5db96dc1b7 is already attached to instances: 493750db-5539-47c2-a9ef-5cbf489b295d {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:31:42.648143 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-56cb408b-3bd1-4a22-888c-38d4b4a1c7f6 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "POST /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101176 Sep 23 15:31:42.648143 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 553/1051] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Sep 23 15:31:42 2022] POST /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 23 15:31:42.710580 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-76dea234-e7c9-403c-9b33-88c0a549e1c5 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:42.711075 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-76dea234-e7c9-403c-9b33-88c0a549e1c5 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:42.717363 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-76dea234-e7c9-403c-9b33-88c0a549e1c5 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:42.717848 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-76dea234-e7c9-403c-9b33-88c0a549e1c5 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:42.718282 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-76dea234-e7c9-403c-9b33-88c0a549e1c5 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:42.718977 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-76dea234-e7c9-403c-9b33-88c0a549e1c5 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:42.719427 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-76dea234-e7c9-403c-9b33-88c0a549e1c5 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:42.719848 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-76dea234-e7c9-403c-9b33-88c0a549e1c5 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:42.800949 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.objects.instance [None req-76dea234-e7c9-403c-9b33-88c0a549e1c5 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lazy-loading 'services' on Instance uuid 493750db-5539-47c2-a9ef-5cbf489b295d {{(pid=121450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:31:43.008388 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-76dea234-e7c9-403c-9b33-88c0a549e1c5 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "DELETE /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d/os-volume_attachments/4f860894-9bec-4b4e-955a-9f5db96dc1b7" status: 202 len: 0 microversion: 2.1 time: 0.301504 Sep 23 15:31:43.008995 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 554/1052] 10.222.0.55 () {58 vars in 1416 bytes} [Fri Sep 23 15:31:42 2022] DELETE /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d/os-volume_attachments/4f860894-9bec-4b4e-955a-9f5db96dc1b7 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 15:31:43.017641 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-cee1b981-f22c-49ee-b288-b76e36200096 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:43.019916 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-cee1b981-f22c-49ee-b288-b76e36200096 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:43.026272 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cee1b981-f22c-49ee-b288-b76e36200096 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:43.026739 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cee1b981-f22c-49ee-b288-b76e36200096 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:43.027178 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cee1b981-f22c-49ee-b288-b76e36200096 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:43.027880 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cee1b981-f22c-49ee-b288-b76e36200096 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:43.028357 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cee1b981-f22c-49ee-b288-b76e36200096 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:43.028783 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-cee1b981-f22c-49ee-b288-b76e36200096 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:43.060439 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-cee1b981-f22c-49ee-b288-b76e36200096 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046944 Sep 23 15:31:43.061009 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 555/1053] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Sep 23 15:31:43 2022] GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:31:44.073874 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-3321b64f-8308-4d55-b143-76f71ff88ad5 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:44.076038 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-3321b64f-8308-4d55-b143-76f71ff88ad5 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:44.082711 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3321b64f-8308-4d55-b143-76f71ff88ad5 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:44.083199 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3321b64f-8308-4d55-b143-76f71ff88ad5 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:44.083697 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3321b64f-8308-4d55-b143-76f71ff88ad5 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:44.084720 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3321b64f-8308-4d55-b143-76f71ff88ad5 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:44.085387 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3321b64f-8308-4d55-b143-76f71ff88ad5 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:44.085817 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3321b64f-8308-4d55-b143-76f71ff88ad5 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:44.117110 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-3321b64f-8308-4d55-b143-76f71ff88ad5 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047080 Sep 23 15:31:44.117782 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 556/1054] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Sep 23 15:31:44 2022] GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 15:31:44.181570 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-abd06687-9f32-468a-91fa-35ff9427756c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:44.182029 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-abd06687-9f32-468a-91fa-35ff9427756c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:44.188003 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-abd06687-9f32-468a-91fa-35ff9427756c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:44.188486 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-abd06687-9f32-468a-91fa-35ff9427756c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:44.188917 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-abd06687-9f32-468a-91fa-35ff9427756c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:44.189599 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-abd06687-9f32-468a-91fa-35ff9427756c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:44.190068 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-abd06687-9f32-468a-91fa-35ff9427756c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:44.190484 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-abd06687-9f32-468a-91fa-35ff9427756c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:44.217839 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-abd06687-9f32-468a-91fa-35ff9427756c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Going to try to terminate instance {{(pid=121450) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:31:44.650840 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-abd06687-9f32-468a-91fa-35ff9427756c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "DELETE /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d" status: 204 len: 0 microversion: 2.1 time: 0.472433 Sep 23 15:31:44.651888 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 557/1055] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Sep 23 15:31:44 2022] DELETE /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 15:31:44.661163 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b5e7ffd0-f61a-424e-aa58-8fa5eb6ce773 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:44.661856 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-b5e7ffd0-f61a-424e-aa58-8fa5eb6ce773 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:44.668035 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b5e7ffd0-f61a-424e-aa58-8fa5eb6ce773 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:44.668520 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b5e7ffd0-f61a-424e-aa58-8fa5eb6ce773 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:44.669131 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b5e7ffd0-f61a-424e-aa58-8fa5eb6ce773 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:44.672156 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b5e7ffd0-f61a-424e-aa58-8fa5eb6ce773 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:44.672631 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b5e7ffd0-f61a-424e-aa58-8fa5eb6ce773 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:44.673049 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b5e7ffd0-f61a-424e-aa58-8fa5eb6ce773 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:44.808623 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-b5e7ffd0-f61a-424e-aa58-8fa5eb6ce773 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:44.817251 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-b5e7ffd0-f61a-424e-aa58-8fa5eb6ce773 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d" status: 200 len: 1682 microversion: 2.1 time: 0.160776 Sep 23 15:31:44.817827 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 558/1056] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:44 2022] GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:31:45.841800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-0e7a0007-38d5-4726-a6a7-d65d6755977a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:45.842738 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-0e7a0007-38d5-4726-a6a7-d65d6755977a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:45.849832 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0e7a0007-38d5-4726-a6a7-d65d6755977a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:45.850371 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0e7a0007-38d5-4726-a6a7-d65d6755977a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:45.850891 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0e7a0007-38d5-4726-a6a7-d65d6755977a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:45.851611 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0e7a0007-38d5-4726-a6a7-d65d6755977a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:45.852091 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0e7a0007-38d5-4726-a6a7-d65d6755977a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:45.852523 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0e7a0007-38d5-4726-a6a7-d65d6755977a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:45.996347 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-0e7a0007-38d5-4726-a6a7-d65d6755977a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:46.004673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-0e7a0007-38d5-4726-a6a7-d65d6755977a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d" status: 200 len: 1682 microversion: 2.1 time: 0.166797 Sep 23 15:31:46.005253 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 559/1057] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:45 2022] GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:31:47.028156 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-6e26e498-e952-463e-9e77-b39bdd508c72 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:47.028774 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-6e26e498-e952-463e-9e77-b39bdd508c72 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:47.044951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e26e498-e952-463e-9e77-b39bdd508c72 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:47.045462 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e26e498-e952-463e-9e77-b39bdd508c72 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:47.045888 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e26e498-e952-463e-9e77-b39bdd508c72 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:47.046612 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e26e498-e952-463e-9e77-b39bdd508c72 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:47.047102 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e26e498-e952-463e-9e77-b39bdd508c72 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:47.047490 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-6e26e498-e952-463e-9e77-b39bdd508c72 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:47.136901 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-6e26e498-e952-463e-9e77-b39bdd508c72 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:47.146142 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-6e26e498-e952-463e-9e77-b39bdd508c72 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d" status: 200 len: 1614 microversion: 2.1 time: 0.121863 Sep 23 15:31:47.147793 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 560/1058] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:47 2022] GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d => generated 1614 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:31:47.154818 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-b4014acb-eb00-4c17-b641-069ea269a6a3 req-a8cb14a4-c2dc-4e12-9635-c494b42c8fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "493750db-5539-47c2-a9ef-5cbf489b295d", "name": "network-vif-deleted", "tag": "19d0ee19-e224-46c7-b495-29b93b0f2d29"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:31:47.171050 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-b4014acb-eb00-4c17-b641-069ea269a6a3 req-a8cb14a4-c2dc-4e12-9635-c494b42c8fc0 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:47.171637 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-b4014acb-eb00-4c17-b641-069ea269a6a3 req-a8cb14a4-c2dc-4e12-9635-c494b42c8fc0 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:47.172174 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-b4014acb-eb00-4c17-b641-069ea269a6a3 req-a8cb14a4-c2dc-4e12-9635-c494b42c8fc0 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:47.186009 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-b4014acb-eb00-4c17-b641-069ea269a6a3 req-a8cb14a4-c2dc-4e12-9635-c494b42c8fc0 service nova] Creating event network-vif-deleted:19d0ee19-e224-46c7-b495-29b93b0f2d29 for instance 493750db-5539-47c2-a9ef-5cbf489b295d on hv-cinder-85530 Sep 23 15:31:47.192826 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-b4014acb-eb00-4c17-b641-069ea269a6a3 req-a8cb14a4-c2dc-4e12-9635-c494b42c8fc0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042974 Sep 23 15:31:47.196906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 561/1059] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:31:48.171776 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b739f765-79bd-4c85-b34a-21564e192e85 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:48.172498 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-b739f765-79bd-4c85-b34a-21564e192e85 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:48.180356 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b739f765-79bd-4c85-b34a-21564e192e85 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:48.180931 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b739f765-79bd-4c85-b34a-21564e192e85 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:48.181364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b739f765-79bd-4c85-b34a-21564e192e85 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:48.182068 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b739f765-79bd-4c85-b34a-21564e192e85 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:48.182516 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b739f765-79bd-4c85-b34a-21564e192e85 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:48.182932 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b739f765-79bd-4c85-b34a-21564e192e85 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:48.227393 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b739f765-79bd-4c85-b34a-21564e192e85 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:48.228332 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b739f765-79bd-4c85-b34a-21564e192e85 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:48.229146 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b739f765-79bd-4c85-b34a-21564e192e85 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:48.229969 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.objects.instance [None req-b739f765-79bd-4c85-b34a-21564e192e85 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lazy-loading 'fault' on Instance uuid 493750db-5539-47c2-a9ef-5cbf489b295d {{(pid=121450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:31:48.277459 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-b739f765-79bd-4c85-b34a-21564e192e85 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:48.286017 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-b739f765-79bd-4c85-b34a-21564e192e85 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d" status: 200 len: 1332 microversion: 2.1 time: 0.118745 Sep 23 15:31:48.286931 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 562/1060] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:48 2022] GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d => generated 1332 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:49.310132 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b7bea48a-495f-4650-bc2e-6ad0e3e0215c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:49.310834 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-b7bea48a-495f-4650-bc2e-6ad0e3e0215c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:49.318043 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b7bea48a-495f-4650-bc2e-6ad0e3e0215c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:49.318522 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b7bea48a-495f-4650-bc2e-6ad0e3e0215c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:49.318957 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b7bea48a-495f-4650-bc2e-6ad0e3e0215c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:49.319651 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b7bea48a-495f-4650-bc2e-6ad0e3e0215c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:49.320211 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b7bea48a-495f-4650-bc2e-6ad0e3e0215c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:49.320628 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b7bea48a-495f-4650-bc2e-6ad0e3e0215c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:49.334876 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-b7bea48a-495f-4650-bc2e-6ad0e3e0215c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] HTTP exception thrown: Instance 493750db-5539-47c2-a9ef-5cbf489b295d could not be found. Sep 23 15:31:49.343457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b7bea48a-495f-4650-bc2e-6ad0e3e0215c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Request method failure captured: Sep 23 15:31:49.343457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d HTTP/1.1 Sep 23 15:31:49.343457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:31:49.343457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:31:49.343457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:31:49.343457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:31:49.343457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:31:49.343457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:31:49.343457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:31:49.343457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:31:49.343457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLdCTXikAD57uZ4i3dSe4iywplg8jFFMGgew7gycP2RSgABkVXdIS1SCcQ0LMjtLpKwvlt669y2zWqhAdPefTh5DX__kK-BecMgkhXY17Yr2p9sKhzOx1ndN07Dq20ojAbxl7nPAtGJYV9vyJrlv0NpmeOM7YjuB8N-lsu2GRmY7Ga1s Sep 23 15:31:49.343457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:31:49.343457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:31:49.343457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:31:49.343457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:31:49.343457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:31:49.343457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:31:49.343457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:31:49.343457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:31:49.343457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:31:49.343457 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:31:49.345103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_695b6a2a390b481bbca2fd367273c268", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}] Sep 23 15:31:49.345103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:31:49.345103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:31:49.345103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:31:49.345103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:31:49.345103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:31:49.345103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:31:49.345103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 97e06913feae4c23a9abbcd508f818d3 Sep 23 15:31:49.345103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:31:49.345103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:31:49.345103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance 493750db-5539-47c2-a9ef-5cbf489b295d could not be found. Sep 23 15:31:49.345103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '493750db-5539-47c2-a9ef-5cbf489b295d'} Sep 23 15:31:49.346002 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:31:49.346002 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:31:49.346002 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:31:49.346002 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:31:49.346002 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:31:49.346002 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:31:49.346002 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:31:49.346002 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:31:49.346002 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:31:49.346002 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:31:49.346002 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 493750db-5539-47c2-a9ef-5cbf489b295d could not be found. Sep 23 15:31:49.346002 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:31:49.346002 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:31:49.346002 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:31:49.346002 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:31:49.346002 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:31:49.346002 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:31:49.346002 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:31:49.346002 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:31:49.346002 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:31:49.347420 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:31:49.347420 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:31:49.347420 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:31:49.347420 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:31:49.347420 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:31:49.347420 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:31:49.347420 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:31:49.347420 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 493750db-5539-47c2-a9ef-5cbf489b295d could not be found. Sep 23 15:31:49.347420 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:31:49.347420 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:31:49.347420 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:31:49.347420 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:31:49.347420 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:31:49.347420 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:31:49.347420 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:31:49.347420 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:31:49.347420 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 493750db-5539-47c2-a9ef-5cbf489b295d could not be found. Sep 23 15:31:49.347420 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:31:49.348900 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b7bea48a-495f-4650-bc2e-6ad0e3e0215c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Returning 404 to user: Instance 493750db-5539-47c2-a9ef-5cbf489b295d could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:31:49.348900 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-b7bea48a-495f-4650-bc2e-6ad0e3e0215c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d" status: 404 len: 111 microversion: 2.1 time: 0.032170 Sep 23 15:31:49.348900 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 563/1061] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:49 2022] GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 15:31:49.348900 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-39e8d93e-acfb-4893-ac80-6c11ef26517a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '.version_select at 0x7f82dbe8ae50>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:49.431208 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-39e8d93e-acfb-4893-ac80-6c11ef26517a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1328957183" status: 202 len: 0 microversion: 2.1 time: 0.087632 Sep 23 15:31:49.431810 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 564/1062] 10.222.0.55 () {58 vars in 1221 bytes} [Fri Sep 23 15:31:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1328957183 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 15:31:50.194378 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-da21b501-64e2-4e0b-8fe2-4af391e6239f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Action: 'create', calling method: .version_select at 0x7f82dbeea5e0>, body: {"keypair": {"name": "tempest-keypair-162558858", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxD22fpn2YIseWDA8OkU0z0nxB9a6DkJMTt+3QQDiL4b7WMtaK3NNTD0Bh83Gpb2YOillWyeC7W1M4NSCMbRzleP+lR/nWyFGbY+yRVP66K2ZuGOHLgyVhl6nJWHabpPA=="}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:31:50.218841 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-da21b501-64e2-4e0b-8fe2-4af391e6239f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Getting quotas for project 695b6a2a390b481bbca2fd367273c268. Resources: {'key_pairs'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:31:50.224225 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-da21b501-64e2-4e0b-8fe2-4af391e6239f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Getting quotas for user 97e06913feae4c23a9abbcd508f818d3 and project 695b6a2a390b481bbca2fd367273c268. Resources: {'key_pairs'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:31:50.361911 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-da21b501-64e2-4e0b-8fe2-4af391e6239f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.171500 Sep 23 15:31:50.362597 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 565/1063] 10.222.0.55 () {60 vars in 1159 bytes} [Fri Sep 23 15:31:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:31:52.897007 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-29e2d417-9c81-4537-a6e1-89a9a6a00b06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-740078946", "imageRef": "051c4746-7f50-4edb-b09d-a8935df360de", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8efafa58-1ac7-4f82-bc57-6974c89b4f6e"}], "security_groups": [{"name": "tempest-securitygroup--1453974437"}], "key_name": "tempest-keypair-162558858", "user_data": "}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:31:53.003056 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.network.neutron [None req-29e2d417-9c81-4537-a6e1-89a9a6a00b06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] validate_networks() for [('8efafa58-1ac7-4f82-bc57-6974c89b4f6e', None, None, None, None, None)] {{(pid=121450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:31:53.378136 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-29e2d417-9c81-4537-a6e1-89a9a6a00b06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Flavor limits 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:31:53.379150 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-29e2d417-9c81-4537-a6e1-89a9a6a00b06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Image limits 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:31:53.379656 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-29e2d417-9c81-4537-a6e1-89a9a6a00b06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Flavor pref 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:31:53.380086 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-29e2d417-9c81-4537-a6e1-89a9a6a00b06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Image pref 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:31:53.380500 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-29e2d417-9c81-4537-a6e1-89a9a6a00b06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:31:53.389502 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-29e2d417-9c81-4537-a6e1-89a9a6a00b06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:53.389969 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-29e2d417-9c81-4537-a6e1-89a9a6a00b06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:53.390404 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-29e2d417-9c81-4537-a6e1-89a9a6a00b06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:53.391153 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-29e2d417-9c81-4537-a6e1-89a9a6a00b06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:53.391588 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-29e2d417-9c81-4537-a6e1-89a9a6a00b06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:53.392040 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-29e2d417-9c81-4537-a6e1-89a9a6a00b06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:53.408887 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-29e2d417-9c81-4537-a6e1-89a9a6a00b06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Getting quotas for project 695b6a2a390b481bbca2fd367273c268. Resources: {'ram', 'instances', 'cores'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:31:53.413733 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-29e2d417-9c81-4537-a6e1-89a9a6a00b06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Getting quotas for user 97e06913feae4c23a9abbcd508f818d3 and project 695b6a2a390b481bbca2fd367273c268. Resources: {'ram', 'instances', 'cores'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:31:53.424772 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-29e2d417-9c81-4537-a6e1-89a9a6a00b06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Going to run 1 instances... {{(pid=121450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:31:53.427622 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-29e2d417-9c81-4537-a6e1-89a9a6a00b06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='051c4746-7f50-4edb-b09d-a8935df360de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:31:53.582444 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-29e2d417-9c81-4537-a6e1-89a9a6a00b06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.691128 Sep 23 15:31:53.583088 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 566/1064] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Sep 23 15:31:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 15:31:53.594295 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a9cccb04-724d-452d-8f8e-682c530c1556 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:53.594914 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-a9cccb04-724d-452d-8f8e-682c530c1556 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:53.650890 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-a9cccb04-724d-452d-8f8e-682c530c1556 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:53.657964 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-a9cccb04-724d-452d-8f8e-682c530c1556 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e" status: 200 len: 1240 microversion: 2.1 time: 0.067683 Sep 23 15:31:53.658606 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 567/1065] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:53 2022] GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:31:54.681138 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-5e25e8d5-d867-468d-9673-c56eef357e83 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:54.681913 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-5e25e8d5-d867-468d-9673-c56eef357e83 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:54.689102 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5e25e8d5-d867-468d-9673-c56eef357e83 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:54.689582 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5e25e8d5-d867-468d-9673-c56eef357e83 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:54.690016 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5e25e8d5-d867-468d-9673-c56eef357e83 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:54.690705 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5e25e8d5-d867-468d-9673-c56eef357e83 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:54.691349 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5e25e8d5-d867-468d-9673-c56eef357e83 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:54.691951 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5e25e8d5-d867-468d-9673-c56eef357e83 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:54.753641 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-5e25e8d5-d867-468d-9673-c56eef357e83 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:54.757256 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:54.761669 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-5e25e8d5-d867-468d-9673-c56eef357e83 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e" status: 200 len: 1244 microversion: 2.1 time: 0.084479 Sep 23 15:31:54.762214 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 568/1066] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:54 2022] GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:31:55.785066 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-e36951c7-85c6-42d3-bbbf-625bdbc11f1f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:55.786081 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-e36951c7-85c6-42d3-bbbf-625bdbc11f1f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:55.793282 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e36951c7-85c6-42d3-bbbf-625bdbc11f1f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:55.793761 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e36951c7-85c6-42d3-bbbf-625bdbc11f1f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:55.794192 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e36951c7-85c6-42d3-bbbf-625bdbc11f1f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:55.794890 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e36951c7-85c6-42d3-bbbf-625bdbc11f1f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:55.795338 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e36951c7-85c6-42d3-bbbf-625bdbc11f1f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:55.795757 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e36951c7-85c6-42d3-bbbf-625bdbc11f1f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:55.869463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-e36951c7-85c6-42d3-bbbf-625bdbc11f1f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:55.877171 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-e36951c7-85c6-42d3-bbbf-625bdbc11f1f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e" status: 200 len: 1300 microversion: 2.1 time: 0.096380 Sep 23 15:31:55.877750 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 569/1067] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:55 2022] GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e => generated 1300 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:56.900884 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-fe94bde6-a9db-4e0e-b85c-1ee1e2bbed59 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:56.901612 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-fe94bde6-a9db-4e0e-b85c-1ee1e2bbed59 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:56.908426 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fe94bde6-a9db-4e0e-b85c-1ee1e2bbed59 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:56.908916 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fe94bde6-a9db-4e0e-b85c-1ee1e2bbed59 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:56.909358 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fe94bde6-a9db-4e0e-b85c-1ee1e2bbed59 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:56.910111 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fe94bde6-a9db-4e0e-b85c-1ee1e2bbed59 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:56.910570 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fe94bde6-a9db-4e0e-b85c-1ee1e2bbed59 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:56.910995 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-fe94bde6-a9db-4e0e-b85c-1ee1e2bbed59 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:57.142959 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-fe94bde6-a9db-4e0e-b85c-1ee1e2bbed59 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:57.151434 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-fe94bde6-a9db-4e0e-b85c-1ee1e2bbed59 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e" status: 200 len: 1366 microversion: 2.1 time: 0.254621 Sep 23 15:31:57.151896 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 570/1068] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:56 2022] GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:31:57.406045 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-79a87262-3cfb-4cdf-a2e1-64afa51ff16e req-1ef41397-20a7-4e42-8816-1c080a9485ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e", "tag": "6ec5a59f-f560-48ce-99dd-bf09f752e04c"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:31:57.416376 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-79a87262-3cfb-4cdf-a2e1-64afa51ff16e req-1ef41397-20a7-4e42-8816-1c080a9485ef service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:57.416855 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-79a87262-3cfb-4cdf-a2e1-64afa51ff16e req-1ef41397-20a7-4e42-8816-1c080a9485ef service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:57.417275 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-79a87262-3cfb-4cdf-a2e1-64afa51ff16e req-1ef41397-20a7-4e42-8816-1c080a9485ef service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:57.429631 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-79a87262-3cfb-4cdf-a2e1-64afa51ff16e req-1ef41397-20a7-4e42-8816-1c080a9485ef service nova] Creating event network-changed:6ec5a59f-f560-48ce-99dd-bf09f752e04c for instance 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e on hv-cinder-85530 Sep 23 15:31:57.434622 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-79a87262-3cfb-4cdf-a2e1-64afa51ff16e req-1ef41397-20a7-4e42-8816-1c080a9485ef service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032443 Sep 23 15:31:57.435236 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 571/1069] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:31:58.179894 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-3d4184c4-b6e7-40c6-bde8-f8f57f11b5a4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:58.181371 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-3d4184c4-b6e7-40c6-bde8-f8f57f11b5a4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:58.189413 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3d4184c4-b6e7-40c6-bde8-f8f57f11b5a4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:58.189909 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3d4184c4-b6e7-40c6-bde8-f8f57f11b5a4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:58.190354 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3d4184c4-b6e7-40c6-bde8-f8f57f11b5a4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:58.191808 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3d4184c4-b6e7-40c6-bde8-f8f57f11b5a4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:58.192365 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3d4184c4-b6e7-40c6-bde8-f8f57f11b5a4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:58.192795 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3d4184c4-b6e7-40c6-bde8-f8f57f11b5a4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:58.435853 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-3d4184c4-b6e7-40c6-bde8-f8f57f11b5a4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:58.444414 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-3d4184c4-b6e7-40c6-bde8-f8f57f11b5a4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e" status: 200 len: 1366 microversion: 2.1 time: 0.273259 Sep 23 15:31:58.444996 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 572/1070] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:58 2022] GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:59.467581 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-3cec6d09-10ba-4a36-bf87-920129ae17c9 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:59.468265 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-3cec6d09-10ba-4a36-bf87-920129ae17c9 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:59.475625 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3cec6d09-10ba-4a36-bf87-920129ae17c9 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:59.476148 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3cec6d09-10ba-4a36-bf87-920129ae17c9 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:59.476584 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3cec6d09-10ba-4a36-bf87-920129ae17c9 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:59.477275 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3cec6d09-10ba-4a36-bf87-920129ae17c9 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:59.477726 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3cec6d09-10ba-4a36-bf87-920129ae17c9 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:59.478150 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3cec6d09-10ba-4a36-bf87-920129ae17c9 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:59.615520 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-3cec6d09-10ba-4a36-bf87-920129ae17c9 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:59.623175 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-3cec6d09-10ba-4a36-bf87-920129ae17c9 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e" status: 200 len: 1366 microversion: 2.1 time: 0.159607 Sep 23 15:31:59.623747 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 573/1071] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:59 2022] GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:32:00.645932 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-167b8d0d-62a7-4ca3-8d4e-82fb5450311b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:32:00.646602 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-167b8d0d-62a7-4ca3-8d4e-82fb5450311b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:32:00.653432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-167b8d0d-62a7-4ca3-8d4e-82fb5450311b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:00.653913 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-167b8d0d-62a7-4ca3-8d4e-82fb5450311b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:00.654347 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-167b8d0d-62a7-4ca3-8d4e-82fb5450311b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:00.655041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-167b8d0d-62a7-4ca3-8d4e-82fb5450311b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:00.655526 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-167b8d0d-62a7-4ca3-8d4e-82fb5450311b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:00.655948 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-167b8d0d-62a7-4ca3-8d4e-82fb5450311b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:00.789890 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-167b8d0d-62a7-4ca3-8d4e-82fb5450311b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:32:00.797668 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-167b8d0d-62a7-4ca3-8d4e-82fb5450311b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e" status: 200 len: 1366 microversion: 2.1 time: 0.156121 Sep 23 15:32:00.798245 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 574/1072] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:32:00 2022] GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:32:01.821849 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-dc284213-76c3-4183-a803-ba55e5606c2f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:32:01.822509 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-dc284213-76c3-4183-a803-ba55e5606c2f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:32:01.828859 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-dc284213-76c3-4183-a803-ba55e5606c2f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:01.829346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-dc284213-76c3-4183-a803-ba55e5606c2f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:01.829784 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-dc284213-76c3-4183-a803-ba55e5606c2f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:01.830480 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-dc284213-76c3-4183-a803-ba55e5606c2f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:01.830940 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-dc284213-76c3-4183-a803-ba55e5606c2f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:01.832242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-dc284213-76c3-4183-a803-ba55e5606c2f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:01.969010 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-dc284213-76c3-4183-a803-ba55e5606c2f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:32:01.976728 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-dc284213-76c3-4183-a803-ba55e5606c2f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e" status: 200 len: 1366 microversion: 2.1 time: 0.158821 Sep 23 15:32:01.977301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 575/1073] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:32:01 2022] GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:32:03.000552 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b0ee894a-10a7-4faa-a25b-e6b71dd0f79a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:32:03.001225 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-b0ee894a-10a7-4faa-a25b-e6b71dd0f79a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:32:03.007900 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b0ee894a-10a7-4faa-a25b-e6b71dd0f79a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:03.008418 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b0ee894a-10a7-4faa-a25b-e6b71dd0f79a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:03.008841 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b0ee894a-10a7-4faa-a25b-e6b71dd0f79a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:03.009539 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b0ee894a-10a7-4faa-a25b-e6b71dd0f79a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:03.009984 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b0ee894a-10a7-4faa-a25b-e6b71dd0f79a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:03.010409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b0ee894a-10a7-4faa-a25b-e6b71dd0f79a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:03.144590 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-b0ee894a-10a7-4faa-a25b-e6b71dd0f79a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:32:03.152281 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-b0ee894a-10a7-4faa-a25b-e6b71dd0f79a tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e" status: 200 len: 1366 microversion: 2.1 time: 0.155566 Sep 23 15:32:03.152846 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 576/1074] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:32:02 2022] GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:32:04.174863 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-5fc5da2d-c7bd-4159-b50a-7faddec67191 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:32:04.175878 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-5fc5da2d-c7bd-4159-b50a-7faddec67191 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:32:04.177423 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell0:SELECT=2 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:04.178112 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell0:SELECT=12 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:04.183363 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5fc5da2d-c7bd-4159-b50a-7faddec67191 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:04.183834 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5fc5da2d-c7bd-4159-b50a-7faddec67191 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:04.184299 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5fc5da2d-c7bd-4159-b50a-7faddec67191 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:04.184995 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5fc5da2d-c7bd-4159-b50a-7faddec67191 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:04.185439 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5fc5da2d-c7bd-4159-b50a-7faddec67191 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:04.185861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5fc5da2d-c7bd-4159-b50a-7faddec67191 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:04.326141 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-5fc5da2d-c7bd-4159-b50a-7faddec67191 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:32:04.334164 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-5fc5da2d-c7bd-4159-b50a-7faddec67191 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e" status: 200 len: 1366 microversion: 2.1 time: 0.163117 Sep 23 15:32:04.335029 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 577/1075] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:32:04 2022] GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:32:04.871662 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-fb341c64-6c25-4b55-8299-2b5bbafcbef6 req-5b4fe69b-493b-4424-9275-edf18f70ebc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e", "name": "network-vif-plugged", "status": "completed", "tag": "6ec5a59f-f560-48ce-99dd-bf09f752e04c"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:32:04.877419 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:04.883775 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-fb341c64-6c25-4b55-8299-2b5bbafcbef6 req-5b4fe69b-493b-4424-9275-edf18f70ebc1 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:04.884284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-fb341c64-6c25-4b55-8299-2b5bbafcbef6 req-5b4fe69b-493b-4424-9275-edf18f70ebc1 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:04.884709 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-fb341c64-6c25-4b55-8299-2b5bbafcbef6 req-5b4fe69b-493b-4424-9275-edf18f70ebc1 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:04.897175 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-fb341c64-6c25-4b55-8299-2b5bbafcbef6 req-5b4fe69b-493b-4424-9275-edf18f70ebc1 service nova] Creating event network-vif-plugged:6ec5a59f-f560-48ce-99dd-bf09f752e04c for instance 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e on hv-cinder-85530 Sep 23 15:32:04.903097 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-fb341c64-6c25-4b55-8299-2b5bbafcbef6 req-5b4fe69b-493b-4424-9275-edf18f70ebc1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162141 Sep 23 15:32:04.903815 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 578/1076] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:32:05.357997 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-4f4711c7-d331-49d4-9cc8-3b6756f842e4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:32:05.358732 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-4f4711c7-d331-49d4-9cc8-3b6756f842e4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:32:05.366540 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4f4711c7-d331-49d4-9cc8-3b6756f842e4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:05.372673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4f4711c7-d331-49d4-9cc8-3b6756f842e4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:05.372673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4f4711c7-d331-49d4-9cc8-3b6756f842e4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:05.372673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4f4711c7-d331-49d4-9cc8-3b6756f842e4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:05.372673 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4f4711c7-d331-49d4-9cc8-3b6756f842e4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:05.373254 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-4f4711c7-d331-49d4-9cc8-3b6756f842e4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:05.508421 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-4f4711c7-d331-49d4-9cc8-3b6756f842e4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:32:05.516323 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-4f4711c7-d331-49d4-9cc8-3b6756f842e4 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e" status: 200 len: 1366 microversion: 2.1 time: 0.163017 Sep 23 15:32:05.516888 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 579/1077] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:32:05 2022] GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:32:06.540396 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-d0dc74b5-7e00-459b-b784-897a18626196 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:32:06.541115 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-d0dc74b5-7e00-459b-b784-897a18626196 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:32:06.547822 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d0dc74b5-7e00-459b-b784-897a18626196 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:06.548302 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d0dc74b5-7e00-459b-b784-897a18626196 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:06.548732 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d0dc74b5-7e00-459b-b784-897a18626196 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:06.549411 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d0dc74b5-7e00-459b-b784-897a18626196 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:06.550345 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d0dc74b5-7e00-459b-b784-897a18626196 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:06.550777 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d0dc74b5-7e00-459b-b784-897a18626196 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:06.689980 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-d0dc74b5-7e00-459b-b784-897a18626196 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:32:06.698540 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-d0dc74b5-7e00-459b-b784-897a18626196 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e" status: 200 len: 1366 microversion: 2.1 time: 0.162171 Sep 23 15:32:06.699115 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 580/1078] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:32:06 2022] GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:32:07.720869 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-d5140231-3f11-4f68-8875-81f130f96b00 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:32:07.721532 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-d5140231-3f11-4f68-8875-81f130f96b00 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:32:07.727945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d5140231-3f11-4f68-8875-81f130f96b00 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:07.728450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d5140231-3f11-4f68-8875-81f130f96b00 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:07.728884 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d5140231-3f11-4f68-8875-81f130f96b00 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:07.729571 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d5140231-3f11-4f68-8875-81f130f96b00 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:07.730018 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d5140231-3f11-4f68-8875-81f130f96b00 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:07.730444 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d5140231-3f11-4f68-8875-81f130f96b00 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:07.859823 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-d5140231-3f11-4f68-8875-81f130f96b00 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:32:07.869615 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-d5140231-3f11-4f68-8875-81f130f96b00 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e" status: 200 len: 1556 microversion: 2.1 time: 0.152697 Sep 23 15:32:07.870184 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 581/1079] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:32:07 2022] GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:32:07.892368 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-09bd5729-6eb2-42cd-b678-db726bb71634 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:32:07.892860 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-09bd5729-6eb2-42cd-b678-db726bb71634 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:32:07.899625 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-09bd5729-6eb2-42cd-b678-db726bb71634 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:07.900144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-09bd5729-6eb2-42cd-b678-db726bb71634 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:07.900581 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-09bd5729-6eb2-42cd-b678-db726bb71634 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:07.901267 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-09bd5729-6eb2-42cd-b678-db726bb71634 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:07.901718 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-09bd5729-6eb2-42cd-b678-db726bb71634 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:07.902139 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-09bd5729-6eb2-42cd-b678-db726bb71634 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:07.984956 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-09bd5729-6eb2-42cd-b678-db726bb71634 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096439 Sep 23 15:32:07.985557 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 582/1080] 10.222.0.55 () {58 vars in 1275 bytes} [Fri Sep 23 15:32:07 2022] GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:32:09.015073 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-e2c3abef-c49e-476b-9fcb-625c75bef1f9 req-80f377b5-f4b9-413b-ac20-b56499b36e93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e", "tag": "6ec5a59f-f560-48ce-99dd-bf09f752e04c"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:32:09.025245 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-e2c3abef-c49e-476b-9fcb-625c75bef1f9 req-80f377b5-f4b9-413b-ac20-b56499b36e93 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:09.025714 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-e2c3abef-c49e-476b-9fcb-625c75bef1f9 req-80f377b5-f4b9-413b-ac20-b56499b36e93 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:09.026167 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-e2c3abef-c49e-476b-9fcb-625c75bef1f9 req-80f377b5-f4b9-413b-ac20-b56499b36e93 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:09.038616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-e2c3abef-c49e-476b-9fcb-625c75bef1f9 req-80f377b5-f4b9-413b-ac20-b56499b36e93 service nova] Creating event network-changed:6ec5a59f-f560-48ce-99dd-bf09f752e04c for instance 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e on hv-cinder-85530 Sep 23 15:32:09.043664 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-e2c3abef-c49e-476b-9fcb-625c75bef1f9 req-80f377b5-f4b9-413b-ac20-b56499b36e93 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032763 Sep 23 15:32:09.044551 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 583/1081] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:32:22.151410 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 15:32:22.152421 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Fri Sep 23 15:32:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.55) !!! Sep 23 15:32:42.804662 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_api:SELECT=11 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:42.805416 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=76 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:42.809606 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-afef48d4-fd67-4f97-960f-72c5f01387b0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:32:42.810181 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-afef48d4-fd67-4f97-960f-72c5f01387b0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:32:42.817092 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-afef48d4-fd67-4f97-960f-72c5f01387b0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:42.817574 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-afef48d4-fd67-4f97-960f-72c5f01387b0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:42.818006 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-afef48d4-fd67-4f97-960f-72c5f01387b0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:42.818696 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-afef48d4-fd67-4f97-960f-72c5f01387b0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:42.819139 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-afef48d4-fd67-4f97-960f-72c5f01387b0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:42.819560 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-afef48d4-fd67-4f97-960f-72c5f01387b0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:42.843360 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-afef48d4-fd67-4f97-960f-72c5f01387b0 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e/ips" status: 200 len: 148 microversion: 2.1 time: 0.040495 Sep 23 15:32:42.843936 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 584/1082] 10.222.0.55 () {58 vars in 1248 bytes} [Fri Sep 23 15:32:42 2022] GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:32:44.750679 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-11d5074c-011b-4a80-9bcf-1faf60fdca2f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3252be2-56f1-4c60-9948-2e77b482a2d7"}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:32:44.753208 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-11d5074c-011b-4a80-9bcf-1faf60fdca2f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:32:44.760156 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-11d5074c-011b-4a80-9bcf-1faf60fdca2f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:44.760703 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-11d5074c-011b-4a80-9bcf-1faf60fdca2f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:44.761144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-11d5074c-011b-4a80-9bcf-1faf60fdca2f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:44.761837 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-11d5074c-011b-4a80-9bcf-1faf60fdca2f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:44.762288 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-11d5074c-011b-4a80-9bcf-1faf60fdca2f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:44.762708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-11d5074c-011b-4a80-9bcf-1faf60fdca2f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:45.617507 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-11d5074c-011b-4a80-9bcf-1faf60fdca2f tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "POST /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.871103 Sep 23 15:32:45.618082 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 585/1083] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Sep 23 15:32:44 2022] POST /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e/os-volume_attachments => generated 194 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:32:53.275477 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-43ff8333-5230-41f9-b873-9acda4ff0655 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:32:53.276184 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-43ff8333-5230-41f9-b873-9acda4ff0655 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:32:53.282518 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-43ff8333-5230-41f9-b873-9acda4ff0655 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:53.283010 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-43ff8333-5230-41f9-b873-9acda4ff0655 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:53.283454 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-43ff8333-5230-41f9-b873-9acda4ff0655 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:53.284191 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-43ff8333-5230-41f9-b873-9acda4ff0655 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:53.284647 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-43ff8333-5230-41f9-b873-9acda4ff0655 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:53.285074 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-43ff8333-5230-41f9-b873-9acda4ff0655 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:53.369846 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.objects.instance [None req-43ff8333-5230-41f9-b873-9acda4ff0655 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lazy-loading 'services' on Instance uuid 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e {{(pid=121450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:32:53.652954 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-43ff8333-5230-41f9-b873-9acda4ff0655 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e/os-volume_attachments/e3252be2-56f1-4c60-9948-2e77b482a2d7" status: 202 len: 0 microversion: 2.1 time: 0.382398 Sep 23 15:32:53.653458 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 586/1084] 10.222.0.55 () {58 vars in 1416 bytes} [Fri Sep 23 15:32:53 2022] DELETE /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e/os-volume_attachments/e3252be2-56f1-4c60-9948-2e77b482a2d7 => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 15:32:53.662697 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-c6513edc-6986-451f-be69-7bed353d0e32 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:32:53.665133 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-c6513edc-6986-451f-be69-7bed353d0e32 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:32:53.671358 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c6513edc-6986-451f-be69-7bed353d0e32 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:53.671850 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c6513edc-6986-451f-be69-7bed353d0e32 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:53.672312 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c6513edc-6986-451f-be69-7bed353d0e32 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:53.673004 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c6513edc-6986-451f-be69-7bed353d0e32 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:53.673448 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c6513edc-6986-451f-be69-7bed353d0e32 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:53.673864 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-c6513edc-6986-451f-be69-7bed353d0e32 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:53.703632 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-c6513edc-6986-451f-be69-7bed353d0e32 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045640 Sep 23 15:32:53.704236 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 587/1085] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Sep 23 15:32:53 2022] GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:32:54.716740 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-aaee97ef-ea1b-4268-ab2e-c0b039f9bbb3 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:32:54.718777 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-aaee97ef-ea1b-4268-ab2e-c0b039f9bbb3 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:32:54.726021 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-aaee97ef-ea1b-4268-ab2e-c0b039f9bbb3 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:54.726545 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-aaee97ef-ea1b-4268-ab2e-c0b039f9bbb3 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:54.726982 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-aaee97ef-ea1b-4268-ab2e-c0b039f9bbb3 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:54.727665 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-aaee97ef-ea1b-4268-ab2e-c0b039f9bbb3 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:54.728220 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-aaee97ef-ea1b-4268-ab2e-c0b039f9bbb3 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:54.737508 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-aaee97ef-ea1b-4268-ab2e-c0b039f9bbb3 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:54.759000 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-aaee97ef-ea1b-4268-ab2e-c0b039f9bbb3 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046323 Sep 23 15:32:54.759572 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 588/1086] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Sep 23 15:32:54 2022] GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 15:32:54.825904 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-03d86de7-f219-4c22-9fbf-5ff83701a3bd tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:32:54.826450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-03d86de7-f219-4c22-9fbf-5ff83701a3bd tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:32:54.832405 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-03d86de7-f219-4c22-9fbf-5ff83701a3bd tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:54.832865 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-03d86de7-f219-4c22-9fbf-5ff83701a3bd tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:54.833304 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-03d86de7-f219-4c22-9fbf-5ff83701a3bd tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:54.834141 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-03d86de7-f219-4c22-9fbf-5ff83701a3bd tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:54.834598 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-03d86de7-f219-4c22-9fbf-5ff83701a3bd tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:54.835027 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-03d86de7-f219-4c22-9fbf-5ff83701a3bd tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:54.861560 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-03d86de7-f219-4c22-9fbf-5ff83701a3bd tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Going to try to terminate instance {{(pid=121450) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:32:55.224714 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-03d86de7-f219-4c22-9fbf-5ff83701a3bd tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e" status: 204 len: 0 microversion: 2.1 time: 0.401736 Sep 23 15:32:55.225659 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 589/1087] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Sep 23 15:32:54 2022] DELETE /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 15:32:55.234987 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-0dccb321-79e8-4b4f-acad-01af3bc0fc6e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:32:55.236814 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-0dccb321-79e8-4b4f-acad-01af3bc0fc6e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:32:55.242325 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0dccb321-79e8-4b4f-acad-01af3bc0fc6e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:55.242820 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0dccb321-79e8-4b4f-acad-01af3bc0fc6e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:55.243251 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0dccb321-79e8-4b4f-acad-01af3bc0fc6e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:55.243949 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0dccb321-79e8-4b4f-acad-01af3bc0fc6e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:55.244437 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0dccb321-79e8-4b4f-acad-01af3bc0fc6e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:55.244856 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0dccb321-79e8-4b4f-acad-01af3bc0fc6e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:55.381212 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-0dccb321-79e8-4b4f-acad-01af3bc0fc6e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:32:55.389195 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-0dccb321-79e8-4b4f-acad-01af3bc0fc6e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e" status: 200 len: 1679 microversion: 2.1 time: 0.158536 Sep 23 15:32:55.389757 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 590/1088] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:32:55 2022] GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:32:56.413696 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-e4d10fa9-dd0e-475f-931a-960b2eb8faf9 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:32:56.414357 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-e4d10fa9-dd0e-475f-931a-960b2eb8faf9 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:32:56.420785 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e4d10fa9-dd0e-475f-931a-960b2eb8faf9 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:56.421300 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e4d10fa9-dd0e-475f-931a-960b2eb8faf9 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:56.421745 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e4d10fa9-dd0e-475f-931a-960b2eb8faf9 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:56.422447 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e4d10fa9-dd0e-475f-931a-960b2eb8faf9 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:56.422904 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e4d10fa9-dd0e-475f-931a-960b2eb8faf9 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:56.423325 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e4d10fa9-dd0e-475f-931a-960b2eb8faf9 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:56.555681 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-e4d10fa9-dd0e-475f-931a-960b2eb8faf9 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:32:56.563581 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-e4d10fa9-dd0e-475f-931a-960b2eb8faf9 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e" status: 200 len: 1679 microversion: 2.1 time: 0.153854 Sep 23 15:32:56.564177 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 591/1089] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:32:56 2022] GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:32:57.588849 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-5343f52c-58f1-4efa-bb8e-3cc6ec5ab61c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:32:57.589631 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-5343f52c-58f1-4efa-bb8e-3cc6ec5ab61c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:32:57.596529 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5343f52c-58f1-4efa-bb8e-3cc6ec5ab61c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:57.596923 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5343f52c-58f1-4efa-bb8e-3cc6ec5ab61c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:57.597360 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5343f52c-58f1-4efa-bb8e-3cc6ec5ab61c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:57.598077 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5343f52c-58f1-4efa-bb8e-3cc6ec5ab61c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:57.598538 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5343f52c-58f1-4efa-bb8e-3cc6ec5ab61c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:57.599019 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-5343f52c-58f1-4efa-bb8e-3cc6ec5ab61c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:57.793964 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-5343f52c-58f1-4efa-bb8e-3cc6ec5ab61c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:32:57.793964 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-5343f52c-58f1-4efa-bb8e-3cc6ec5ab61c tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e" status: 200 len: 1611 microversion: 2.1 time: 0.165741 Sep 23 15:32:57.793964 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 592/1090] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:32:57 2022] GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e => generated 1611 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:32:57.925379 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-01b57f01-c388-4369-a413-c343fe317a3b req-1fdbf2e1-7029-4ce1-9b63-7af6e8c2e179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e", "name": "network-vif-deleted", "tag": "6ec5a59f-f560-48ce-99dd-bf09f752e04c"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:32:57.936117 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-01b57f01-c388-4369-a413-c343fe317a3b req-1fdbf2e1-7029-4ce1-9b63-7af6e8c2e179 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:57.940432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-01b57f01-c388-4369-a413-c343fe317a3b req-1fdbf2e1-7029-4ce1-9b63-7af6e8c2e179 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:57.940432 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-01b57f01-c388-4369-a413-c343fe317a3b req-1fdbf2e1-7029-4ce1-9b63-7af6e8c2e179 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:57.950041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-01b57f01-c388-4369-a413-c343fe317a3b req-1fdbf2e1-7029-4ce1-9b63-7af6e8c2e179 service nova] Creating event network-vif-deleted:6ec5a59f-f560-48ce-99dd-bf09f752e04c for instance 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e on hv-cinder-85530 Sep 23 15:32:57.954906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-01b57f01-c388-4369-a413-c343fe317a3b req-1fdbf2e1-7029-4ce1-9b63-7af6e8c2e179 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033357 Sep 23 15:32:57.955509 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 593/1091] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:32:58.777969 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b4c8d68a-a174-4548-8ee7-cce302a31463 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:32:58.779024 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-b4c8d68a-a174-4548-8ee7-cce302a31463 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:32:58.784650 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b4c8d68a-a174-4548-8ee7-cce302a31463 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:58.785124 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b4c8d68a-a174-4548-8ee7-cce302a31463 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:58.785651 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b4c8d68a-a174-4548-8ee7-cce302a31463 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:58.786498 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b4c8d68a-a174-4548-8ee7-cce302a31463 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:58.787834 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b4c8d68a-a174-4548-8ee7-cce302a31463 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:58.787963 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b4c8d68a-a174-4548-8ee7-cce302a31463 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:58.821896 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b4c8d68a-a174-4548-8ee7-cce302a31463 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:58.822404 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b4c8d68a-a174-4548-8ee7-cce302a31463 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:58.822842 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b4c8d68a-a174-4548-8ee7-cce302a31463 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:58.823288 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.objects.instance [None req-b4c8d68a-a174-4548-8ee7-cce302a31463 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lazy-loading 'fault' on Instance uuid 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e {{(pid=121450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:32:58.872622 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-b4c8d68a-a174-4548-8ee7-cce302a31463 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e06913feae4c23a9abbcd508f818d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695b6a2a390b481bbca2fd367273c268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:32:58.887868 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-b4c8d68a-a174-4548-8ee7-cce302a31463 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e" status: 200 len: 1330 microversion: 2.1 time: 0.114831 Sep 23 15:32:58.888729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 594/1092] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:32:58 2022] GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e => generated 1330 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:32:59.912487 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-273cc348-8db0-4b06-9e47-e6bd98b16456 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:32:59.913174 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-273cc348-8db0-4b06-9e47-e6bd98b16456 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:32:59.919539 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-273cc348-8db0-4b06-9e47-e6bd98b16456 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:59.920058 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-273cc348-8db0-4b06-9e47-e6bd98b16456 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:59.920500 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-273cc348-8db0-4b06-9e47-e6bd98b16456 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:59.921198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-273cc348-8db0-4b06-9e47-e6bd98b16456 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:32:59.921653 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-273cc348-8db0-4b06-9e47-e6bd98b16456 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:32:59.922071 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-273cc348-8db0-4b06-9e47-e6bd98b16456 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:32:59.935967 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-273cc348-8db0-4b06-9e47-e6bd98b16456 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] HTTP exception thrown: Instance 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e could not be found. Sep 23 15:32:59.937648 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-273cc348-8db0-4b06-9e47-e6bd98b16456 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Request method failure captured: Sep 23 15:32:59.937648 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e HTTP/1.1 Sep 23 15:32:59.937648 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:32:59.937648 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:32:59.937648 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:32:59.937648 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:32:59.937648 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:32:59.937648 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:32:59.937648 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:32:59.937648 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:32:59.937648 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLdCTXikAD57uZ4i3dSe4iywplg8jFFMGgew7gycP2RSgABkVXdIS1SCcQ0LMjtLpKwvlt669y2zWqhAdPefTh5DX__kK-BecMgkhXY17Yr2p9sKhzOx1ndN07Dq20ojAbxl7nPAtGJYV9vyJrlv0NpmeOM7YjuB8N-lsu2GRmY7Ga1s Sep 23 15:32:59.937648 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:32:59.937648 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:32:59.937648 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:32:59.937648 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:32:59.937648 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:32:59.937648 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:32:59.937648 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:32:59.937648 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:32:59.937648 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:32:59.937648 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:32:59.939572 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_695b6a2a390b481bbca2fd367273c268", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}] Sep 23 15:32:59.939572 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:32:59.939572 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:32:59.939572 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:32:59.939572 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:32:59.939572 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:32:59.939572 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:32:59.939572 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 97e06913feae4c23a9abbcd508f818d3 Sep 23 15:32:59.939572 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:32:59.939572 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:32:59.939572 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e could not be found. Sep 23 15:32:59.939572 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e'} Sep 23 15:32:59.940767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:32:59.940767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:32:59.940767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:32:59.940767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:32:59.940767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:32:59.940767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:32:59.940767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:32:59.940767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:32:59.940767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:32:59.940767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:32:59.940767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e could not be found. Sep 23 15:32:59.940767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:32:59.940767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:32:59.940767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:32:59.940767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:32:59.940767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:32:59.940767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:32:59.940767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:32:59.940767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:32:59.940767 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:32:59.942400 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:32:59.942400 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:32:59.942400 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:32:59.942400 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:32:59.942400 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:32:59.942400 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:32:59.942400 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:32:59.942400 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e could not be found. Sep 23 15:32:59.942400 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:32:59.942400 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:32:59.942400 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:32:59.942400 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:32:59.942400 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:32:59.942400 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:32:59.942400 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:32:59.942400 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:32:59.942400 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e could not be found. Sep 23 15:32:59.942400 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:32:59.944726 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-273cc348-8db0-4b06-9e47-e6bd98b16456 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Returning 404 to user: Instance 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:32:59.944726 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-273cc348-8db0-4b06-9e47-e6bd98b16456 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e" status: 404 len: 111 microversion: 2.1 time: 0.030483 Sep 23 15:32:59.944726 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 595/1093] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:32:59 2022] GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 15:32:59.948764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-bdb55e4f-8e6a-44b5-b103-433d8f257e86 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '.version_select at 0x7f82dbb63160>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:00.030978 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-bdb55e4f-8e6a-44b5-b103-433d8f257e86 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-162558858" status: 202 len: 0 microversion: 2.1 time: 0.085829 Sep 23 15:33:00.031559 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 596/1094] 10.222.0.55 () {58 vars in 1218 bytes} [Fri Sep 23 15:32:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-162558858 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:33:02.188496 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-99edb021-254a-4ae1-b840-e06033a05836 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:02.189380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-99edb021-254a-4ae1-b840-e06033a05836 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:02.204945 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-99edb021-254a-4ae1-b840-e06033a05836 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:02.205855 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-99edb021-254a-4ae1-b840-e06033a05836 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:02.206641 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-99edb021-254a-4ae1-b840-e06033a05836 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:02.207881 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-99edb021-254a-4ae1-b840-e06033a05836 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:02.209416 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-99edb021-254a-4ae1-b840-e06033a05836 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:02.210196 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-99edb021-254a-4ae1-b840-e06033a05836 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:02.223963 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-99edb021-254a-4ae1-b840-e06033a05836 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] HTTP exception thrown: Instance 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e could not be found. Sep 23 15:33:02.225542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-99edb021-254a-4ae1-b840-e06033a05836 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Request method failure captured: Sep 23 15:33:02.225542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: DELETE /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e HTTP/1.1 Sep 23 15:33:02.225542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:33:02.225542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:33:02.225542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:33:02.225542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:33:02.225542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:33:02.225542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:33:02.225542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:33:02.225542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:33:02.225542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLdCTXikAD57uZ4i3dSe4iywplg8jFFMGgew7gycP2RSgABkVXdIS1SCcQ0LMjtLpKwvlt669y2zWqhAdPefTh5DX__kK-BecMgkhXY17Yr2p9sKhzOx1ndN07Dq20ojAbxl7nPAtGJYV9vyJrlv0NpmeOM7YjuB8N-lsu2GRmY7Ga1s Sep 23 15:33:02.225542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:33:02.225542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:33:02.225542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:33:02.225542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:33:02.225542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:33:02.225542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:33:02.225542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:33:02.225542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:33:02.225542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:33:02.225542 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:33:02.227182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_695b6a2a390b481bbca2fd367273c268", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}] Sep 23 15:33:02.227182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:33:02.227182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:33:02.227182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:33:02.227182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:33:02.227182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:33:02.227182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:33:02.227182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 97e06913feae4c23a9abbcd508f818d3 Sep 23 15:33:02.227182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:33:02.227182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:33:02.227182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e could not be found. Sep 23 15:33:02.227182 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e'} Sep 23 15:33:02.228144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:33:02.228144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:02.228144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:33:02.228144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:33:02.228144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:33:02.228144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:33:02.228144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:33:02.228144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:33:02.228144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:33:02.228144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:33:02.228144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e could not be found. Sep 23 15:33:02.228144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:02.228144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:33:02.228144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:02.228144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:02.228144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:33:02.228144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:33:02.228144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:33:02.228144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:33:02.228144 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:33:02.229689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:33:02.229689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 15:33:02.229689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 15:33:02.229689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 15:33:02.229689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 15:33:02.229689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:33:02.229689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:33:02.229689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:33:02.229689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:33:02.229689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e could not be found. Sep 23 15:33:02.229689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:02.229689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:33:02.229689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:02.229689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:02.229689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:33:02.229689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:33:02.229689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:33:02.229689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:33:02.229689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e could not be found. Sep 23 15:33:02.229689 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:02.231356 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-99edb021-254a-4ae1-b840-e06033a05836 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Returning 404 to user: Instance 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:33:02.231356 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-99edb021-254a-4ae1-b840-e06033a05836 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e" status: 404 len: 111 microversion: 2.1 time: 0.045745 Sep 23 15:33:02.231356 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 597/1095] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Sep 23 15:33:02 2022] DELETE /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 15:33:02.235262 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-df8fe261-6a03-4c58-8239-9449f8708c06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:02.235861 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-df8fe261-6a03-4c58-8239-9449f8708c06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:02.242153 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-df8fe261-6a03-4c58-8239-9449f8708c06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:02.242633 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-df8fe261-6a03-4c58-8239-9449f8708c06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:02.243066 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-df8fe261-6a03-4c58-8239-9449f8708c06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:02.243754 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-df8fe261-6a03-4c58-8239-9449f8708c06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:02.244241 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-df8fe261-6a03-4c58-8239-9449f8708c06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:02.244660 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-df8fe261-6a03-4c58-8239-9449f8708c06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:02.258694 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-df8fe261-6a03-4c58-8239-9449f8708c06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] HTTP exception thrown: Instance 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e could not be found. Sep 23 15:33:02.260242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-df8fe261-6a03-4c58-8239-9449f8708c06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Request method failure captured: Sep 23 15:33:02.260242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e HTTP/1.1 Sep 23 15:33:02.260242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:33:02.260242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:33:02.260242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:33:02.260242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:33:02.260242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:33:02.260242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:33:02.260242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:33:02.260242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:33:02.260242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLdCTXikAD57uZ4i3dSe4iywplg8jFFMGgew7gycP2RSgABkVXdIS1SCcQ0LMjtLpKwvlt669y2zWqhAdPefTh5DX__kK-BecMgkhXY17Yr2p9sKhzOx1ndN07Dq20ojAbxl7nPAtGJYV9vyJrlv0NpmeOM7YjuB8N-lsu2GRmY7Ga1s Sep 23 15:33:02.260242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:33:02.260242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:33:02.260242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:33:02.260242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:33:02.260242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:33:02.260242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:33:02.260242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:33:02.260242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:33:02.260242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:33:02.260242 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:33:02.262214 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_695b6a2a390b481bbca2fd367273c268", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}] Sep 23 15:33:02.262214 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:33:02.262214 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:33:02.262214 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:33:02.262214 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:33:02.262214 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:33:02.262214 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:33:02.262214 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 97e06913feae4c23a9abbcd508f818d3 Sep 23 15:33:02.262214 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:33:02.262214 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:33:02.262214 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e could not be found. Sep 23 15:33:02.262214 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e'} Sep 23 15:33:02.263133 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:33:02.263133 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:02.263133 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:33:02.263133 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:33:02.263133 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:33:02.263133 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:33:02.263133 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:33:02.263133 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:33:02.263133 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:33:02.263133 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:33:02.263133 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e could not be found. Sep 23 15:33:02.263133 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:02.263133 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:33:02.263133 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:02.263133 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:02.263133 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:33:02.263133 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:33:02.263133 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:33:02.263133 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:33:02.263133 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:33:02.264630 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:33:02.264630 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:33:02.264630 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:33:02.264630 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:33:02.264630 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:33:02.264630 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:33:02.264630 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:33:02.264630 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e could not be found. Sep 23 15:33:02.264630 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:02.264630 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:33:02.264630 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:02.264630 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:02.264630 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:33:02.264630 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:33:02.264630 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:33:02.264630 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:33:02.264630 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e could not be found. Sep 23 15:33:02.264630 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:02.266410 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-df8fe261-6a03-4c58-8239-9449f8708c06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Returning 404 to user: Instance 6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:33:02.266410 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-df8fe261-6a03-4c58-8239-9449f8708c06 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e" status: 404 len: 111 microversion: 2.1 time: 0.029879 Sep 23 15:33:02.266410 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 598/1096] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:02 2022] GET /compute/v2.1/servers/6d9a4983-1e53-4bb1-adec-7a0a0a4d0f8e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:33:03.580521 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-ef8b4ccf-ec19-4afe-b3e5-ea06b182425e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:03.581115 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-ef8b4ccf-ec19-4afe-b3e5-ea06b182425e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:03.588241 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ef8b4ccf-ec19-4afe-b3e5-ea06b182425e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:03.588722 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ef8b4ccf-ec19-4afe-b3e5-ea06b182425e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:03.589154 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ef8b4ccf-ec19-4afe-b3e5-ea06b182425e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:03.589842 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ef8b4ccf-ec19-4afe-b3e5-ea06b182425e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:03.590291 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ef8b4ccf-ec19-4afe-b3e5-ea06b182425e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:03.590710 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-ef8b4ccf-ec19-4afe-b3e5-ea06b182425e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:03.604204 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-ef8b4ccf-ec19-4afe-b3e5-ea06b182425e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] HTTP exception thrown: Instance 493750db-5539-47c2-a9ef-5cbf489b295d could not be found. Sep 23 15:33:03.605746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-ef8b4ccf-ec19-4afe-b3e5-ea06b182425e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Request method failure captured: Sep 23 15:33:03.605746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: DELETE /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d HTTP/1.1 Sep 23 15:33:03.605746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:33:03.605746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:33:03.605746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:33:03.605746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:33:03.605746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:33:03.605746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:33:03.605746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:33:03.605746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:33:03.605746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLdCTXikAD57uZ4i3dSe4iywplg8jFFMGgew7gycP2RSgABkVXdIS1SCcQ0LMjtLpKwvlt669y2zWqhAdPefTh5DX__kK-BecMgkhXY17Yr2p9sKhzOx1ndN07Dq20ojAbxl7nPAtGJYV9vyJrlv0NpmeOM7YjuB8N-lsu2GRmY7Ga1s Sep 23 15:33:03.605746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:33:03.605746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:33:03.605746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:33:03.605746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:33:03.605746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:33:03.605746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:33:03.605746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:33:03.605746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:33:03.605746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:33:03.605746 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:33:03.607443 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_695b6a2a390b481bbca2fd367273c268", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}] Sep 23 15:33:03.607443 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:33:03.607443 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:33:03.607443 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:33:03.607443 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:33:03.607443 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:33:03.607443 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:33:03.607443 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 97e06913feae4c23a9abbcd508f818d3 Sep 23 15:33:03.607443 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:33:03.607443 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:33:03.607443 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance 493750db-5539-47c2-a9ef-5cbf489b295d could not be found. Sep 23 15:33:03.607443 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '493750db-5539-47c2-a9ef-5cbf489b295d'} Sep 23 15:33:03.608450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:33:03.608450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:03.608450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:33:03.608450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:33:03.608450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:33:03.608450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:33:03.608450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:33:03.608450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:33:03.608450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:33:03.608450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:33:03.608450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 493750db-5539-47c2-a9ef-5cbf489b295d could not be found. Sep 23 15:33:03.608450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:03.608450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:33:03.608450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:03.608450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:03.608450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:33:03.608450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:33:03.608450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:33:03.608450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:33:03.608450 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:33:03.610041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:33:03.610041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 15:33:03.610041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 15:33:03.610041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 15:33:03.610041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 15:33:03.610041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:33:03.610041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:33:03.610041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:33:03.610041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:33:03.610041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 493750db-5539-47c2-a9ef-5cbf489b295d could not be found. Sep 23 15:33:03.610041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:03.610041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:33:03.610041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:03.610041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:03.610041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:33:03.610041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:33:03.610041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:33:03.610041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:33:03.610041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 493750db-5539-47c2-a9ef-5cbf489b295d could not be found. Sep 23 15:33:03.610041 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:03.611791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-ef8b4ccf-ec19-4afe-b3e5-ea06b182425e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Returning 404 to user: Instance 493750db-5539-47c2-a9ef-5cbf489b295d could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:33:03.611791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-ef8b4ccf-ec19-4afe-b3e5-ea06b182425e tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "DELETE /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d" status: 404 len: 111 microversion: 2.1 time: 0.030409 Sep 23 15:33:03.611791 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 599/1097] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Sep 23 15:33:03 2022] DELETE /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 15:33:03.615691 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-f34764ae-cbb0-44de-99d4-7875cb631001 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:03.616320 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-f34764ae-cbb0-44de-99d4-7875cb631001 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 493750db-5539-47c2-a9ef-5cbf489b295d] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:03.622150 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f34764ae-cbb0-44de-99d4-7875cb631001 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:03.622635 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f34764ae-cbb0-44de-99d4-7875cb631001 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:03.623067 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f34764ae-cbb0-44de-99d4-7875cb631001 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:03.623754 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f34764ae-cbb0-44de-99d4-7875cb631001 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:03.624254 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f34764ae-cbb0-44de-99d4-7875cb631001 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:03.624678 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-f34764ae-cbb0-44de-99d4-7875cb631001 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:03.638900 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-f34764ae-cbb0-44de-99d4-7875cb631001 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] HTTP exception thrown: Instance 493750db-5539-47c2-a9ef-5cbf489b295d could not be found. Sep 23 15:33:03.640459 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-f34764ae-cbb0-44de-99d4-7875cb631001 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Request method failure captured: Sep 23 15:33:03.640459 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d HTTP/1.1 Sep 23 15:33:03.640459 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:33:03.640459 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:33:03.640459 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:33:03.640459 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:33:03.640459 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:33:03.640459 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:33:03.640459 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:33:03.640459 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:33:03.640459 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLdCTXikAD57uZ4i3dSe4iywplg8jFFMGgew7gycP2RSgABkVXdIS1SCcQ0LMjtLpKwvlt669y2zWqhAdPefTh5DX__kK-BecMgkhXY17Yr2p9sKhzOx1ndN07Dq20ojAbxl7nPAtGJYV9vyJrlv0NpmeOM7YjuB8N-lsu2GRmY7Ga1s Sep 23 15:33:03.640459 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:33:03.640459 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:33:03.640459 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:33:03.640459 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:33:03.640459 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:33:03.640459 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:33:03.640459 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:33:03.640459 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:33:03.640459 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:33:03.640459 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:33:03.642139 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_695b6a2a390b481bbca2fd367273c268", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}] Sep 23 15:33:03.642139 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:33:03.642139 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:33:03.642139 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:33:03.642139 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:33:03.642139 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:33:03.642139 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:33:03.642139 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 97e06913feae4c23a9abbcd508f818d3 Sep 23 15:33:03.642139 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:33:03.642139 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:33:03.642139 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance 493750db-5539-47c2-a9ef-5cbf489b295d could not be found. Sep 23 15:33:03.642139 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '493750db-5539-47c2-a9ef-5cbf489b295d'} Sep 23 15:33:03.643121 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:33:03.643121 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:03.643121 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:33:03.643121 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:33:03.643121 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:33:03.643121 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:33:03.643121 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:33:03.643121 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:33:03.643121 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:33:03.643121 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:33:03.643121 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 493750db-5539-47c2-a9ef-5cbf489b295d could not be found. Sep 23 15:33:03.643121 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:03.643121 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:33:03.643121 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:03.643121 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:03.643121 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:33:03.643121 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:33:03.643121 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:33:03.643121 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:33:03.643121 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:33:03.644708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:33:03.644708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:33:03.644708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:33:03.644708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:33:03.644708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:33:03.644708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:33:03.644708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:33:03.644708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 493750db-5539-47c2-a9ef-5cbf489b295d could not be found. Sep 23 15:33:03.644708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:03.644708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:33:03.644708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:03.644708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:03.644708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:33:03.644708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:33:03.644708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:33:03.644708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:33:03.644708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 493750db-5539-47c2-a9ef-5cbf489b295d could not be found. Sep 23 15:33:03.644708 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:03.647372 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-f34764ae-cbb0-44de-99d4-7875cb631001 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Returning 404 to user: Instance 493750db-5539-47c2-a9ef-5cbf489b295d could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:33:03.647372 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-f34764ae-cbb0-44de-99d4-7875cb631001 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d" status: 404 len: 111 microversion: 2.1 time: 0.030221 Sep 23 15:33:03.647372 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 600/1098] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:03 2022] GET /compute/v2.1/servers/493750db-5539-47c2-a9ef-5cbf489b295d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:33:03.650903 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-d4c9763f-7281-4aa7-b448-f9c97eef512b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:03.651406 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-d4c9763f-7281-4aa7-b448-f9c97eef512b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 8c0e8c64-53b0-4195-911d-a4e0444dc147] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:03.657396 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d4c9763f-7281-4aa7-b448-f9c97eef512b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:03.657914 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d4c9763f-7281-4aa7-b448-f9c97eef512b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:03.658350 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d4c9763f-7281-4aa7-b448-f9c97eef512b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:03.659020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d4c9763f-7281-4aa7-b448-f9c97eef512b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:03.659669 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d4c9763f-7281-4aa7-b448-f9c97eef512b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:03.660132 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-d4c9763f-7281-4aa7-b448-f9c97eef512b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:03.674371 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-d4c9763f-7281-4aa7-b448-f9c97eef512b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] HTTP exception thrown: Instance 8c0e8c64-53b0-4195-911d-a4e0444dc147 could not be found. Sep 23 15:33:03.675906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-d4c9763f-7281-4aa7-b448-f9c97eef512b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Request method failure captured: Sep 23 15:33:03.675906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: DELETE /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147 HTTP/1.1 Sep 23 15:33:03.675906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:33:03.675906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:33:03.675906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:33:03.675906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:33:03.675906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:33:03.675906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:33:03.675906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:33:03.675906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:33:03.675906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLdCTXikAD57uZ4i3dSe4iywplg8jFFMGgew7gycP2RSgABkVXdIS1SCcQ0LMjtLpKwvlt669y2zWqhAdPefTh5DX__kK-BecMgkhXY17Yr2p9sKhzOx1ndN07Dq20ojAbxl7nPAtGJYV9vyJrlv0NpmeOM7YjuB8N-lsu2GRmY7Ga1s Sep 23 15:33:03.675906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:33:03.675906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:33:03.675906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:33:03.675906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:33:03.675906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:33:03.675906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:33:03.675906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:33:03.675906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:33:03.675906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:33:03.675906 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:33:03.678479 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_695b6a2a390b481bbca2fd367273c268", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}] Sep 23 15:33:03.678479 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:33:03.678479 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:33:03.678479 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:33:03.678479 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:33:03.678479 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:33:03.678479 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:33:03.678479 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 97e06913feae4c23a9abbcd508f818d3 Sep 23 15:33:03.678479 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:33:03.678479 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:33:03.678479 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance 8c0e8c64-53b0-4195-911d-a4e0444dc147 could not be found. Sep 23 15:33:03.678479 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '8c0e8c64-53b0-4195-911d-a4e0444dc147'} Sep 23 15:33:03.679287 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:33:03.679287 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:03.679287 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:33:03.679287 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:33:03.679287 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:33:03.679287 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:33:03.679287 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:33:03.679287 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:33:03.679287 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:33:03.679287 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:33:03.679287 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c0e8c64-53b0-4195-911d-a4e0444dc147 could not be found. Sep 23 15:33:03.679287 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:03.679287 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:33:03.679287 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:03.679287 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:03.679287 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:33:03.679287 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:33:03.679287 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:33:03.679287 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:33:03.679287 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:33:03.680629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:33:03.680629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 15:33:03.680629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 15:33:03.680629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 15:33:03.680629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 15:33:03.680629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:33:03.680629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:33:03.680629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:33:03.680629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:33:03.680629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c0e8c64-53b0-4195-911d-a4e0444dc147 could not be found. Sep 23 15:33:03.680629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:03.680629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:33:03.680629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:03.680629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:03.680629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:33:03.680629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:33:03.680629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:33:03.680629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:33:03.680629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c0e8c64-53b0-4195-911d-a4e0444dc147 could not be found. Sep 23 15:33:03.680629 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:03.682313 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-d4c9763f-7281-4aa7-b448-f9c97eef512b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Returning 404 to user: Instance 8c0e8c64-53b0-4195-911d-a4e0444dc147 could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:33:03.682313 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-d4c9763f-7281-4aa7-b448-f9c97eef512b tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "DELETE /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147" status: 404 len: 111 microversion: 2.1 time: 0.030399 Sep 23 15:33:03.682313 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 601/1099] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Sep 23 15:33:03 2022] DELETE /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:33:03.686116 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a41203a5-ed1e-4608-a544-c481bad5a279 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:03.686729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-a41203a5-ed1e-4608-a544-c481bad5a279 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 8c0e8c64-53b0-4195-911d-a4e0444dc147] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:03.693331 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a41203a5-ed1e-4608-a544-c481bad5a279 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:03.693809 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a41203a5-ed1e-4608-a544-c481bad5a279 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:03.694253 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a41203a5-ed1e-4608-a544-c481bad5a279 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:03.694946 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a41203a5-ed1e-4608-a544-c481bad5a279 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:03.695470 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a41203a5-ed1e-4608-a544-c481bad5a279 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:03.695828 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-a41203a5-ed1e-4608-a544-c481bad5a279 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:03.710656 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-a41203a5-ed1e-4608-a544-c481bad5a279 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] HTTP exception thrown: Instance 8c0e8c64-53b0-4195-911d-a4e0444dc147 could not be found. Sep 23 15:33:03.712333 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a41203a5-ed1e-4608-a544-c481bad5a279 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Request method failure captured: Sep 23 15:33:03.712333 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147 HTTP/1.1 Sep 23 15:33:03.712333 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:33:03.712333 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:33:03.712333 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:33:03.712333 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:33:03.712333 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:33:03.712333 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:33:03.712333 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:33:03.712333 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:33:03.712333 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLdCTXikAD57uZ4i3dSe4iywplg8jFFMGgew7gycP2RSgABkVXdIS1SCcQ0LMjtLpKwvlt669y2zWqhAdPefTh5DX__kK-BecMgkhXY17Yr2p9sKhzOx1ndN07Dq20ojAbxl7nPAtGJYV9vyJrlv0NpmeOM7YjuB8N-lsu2GRmY7Ga1s Sep 23 15:33:03.712333 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:33:03.712333 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:33:03.712333 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:33:03.712333 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:33:03.712333 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:33:03.712333 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:33:03.712333 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:33:03.712333 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:33:03.712333 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:33:03.712333 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:33:03.713971 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_695b6a2a390b481bbca2fd367273c268", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}] Sep 23 15:33:03.713971 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:33:03.713971 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:33:03.713971 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:33:03.713971 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:33:03.713971 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:33:03.713971 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:33:03.713971 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 97e06913feae4c23a9abbcd508f818d3 Sep 23 15:33:03.713971 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:33:03.713971 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:33:03.713971 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance 8c0e8c64-53b0-4195-911d-a4e0444dc147 could not be found. Sep 23 15:33:03.713971 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '8c0e8c64-53b0-4195-911d-a4e0444dc147'} Sep 23 15:33:03.714924 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:33:03.714924 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:03.714924 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:33:03.714924 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:33:03.714924 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:33:03.714924 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:33:03.714924 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:33:03.714924 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:33:03.714924 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:33:03.714924 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:33:03.714924 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c0e8c64-53b0-4195-911d-a4e0444dc147 could not be found. Sep 23 15:33:03.714924 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:03.714924 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:33:03.714924 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:03.714924 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:03.714924 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:33:03.714924 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:33:03.714924 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:33:03.714924 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:33:03.714924 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:33:03.731197 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:33:03.731197 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:33:03.731197 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:33:03.731197 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:33:03.731197 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:33:03.731197 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:33:03.731197 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:33:03.731197 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c0e8c64-53b0-4195-911d-a4e0444dc147 could not be found. Sep 23 15:33:03.731197 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:03.731197 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:33:03.731197 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:03.731197 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:03.731197 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:33:03.731197 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:33:03.731197 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:33:03.731197 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:33:03.731197 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c0e8c64-53b0-4195-911d-a4e0444dc147 could not be found. Sep 23 15:33:03.731197 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:03.733088 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-a41203a5-ed1e-4608-a544-c481bad5a279 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Returning 404 to user: Instance 8c0e8c64-53b0-4195-911d-a4e0444dc147 could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:33:03.733088 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-a41203a5-ed1e-4608-a544-c481bad5a279 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147" status: 404 len: 111 microversion: 2.1 time: 0.031159 Sep 23 15:33:03.733088 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 602/1100] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:03 2022] GET /compute/v2.1/servers/8c0e8c64-53b0-4195-911d-a4e0444dc147 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 15:33:05.015748 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-63c4a0f7-406b-45a4-9a22-eceb6167cdd7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:05.016388 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-63c4a0f7-406b-45a4-9a22-eceb6167cdd7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:05.023298 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-63c4a0f7-406b-45a4-9a22-eceb6167cdd7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:05.023776 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-63c4a0f7-406b-45a4-9a22-eceb6167cdd7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:05.024248 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-63c4a0f7-406b-45a4-9a22-eceb6167cdd7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:05.024940 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-63c4a0f7-406b-45a4-9a22-eceb6167cdd7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:05.025394 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-63c4a0f7-406b-45a4-9a22-eceb6167cdd7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:05.025818 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-63c4a0f7-406b-45a4-9a22-eceb6167cdd7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:05.029941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:05.040195 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-63c4a0f7-406b-45a4-9a22-eceb6167cdd7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] HTTP exception thrown: Instance 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 could not be found. Sep 23 15:33:05.045764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-63c4a0f7-406b-45a4-9a22-eceb6167cdd7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Request method failure captured: Sep 23 15:33:05.045764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: DELETE /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 HTTP/1.1 Sep 23 15:33:05.045764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:33:05.045764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:33:05.045764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:33:05.045764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:33:05.045764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:33:05.045764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:33:05.045764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:33:05.045764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:33:05.045764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLdCTXikAD57uZ4i3dSe4iywplg8jFFMGgew7gycP2RSgABkVXdIS1SCcQ0LMjtLpKwvlt669y2zWqhAdPefTh5DX__kK-BecMgkhXY17Yr2p9sKhzOx1ndN07Dq20ojAbxl7nPAtGJYV9vyJrlv0NpmeOM7YjuB8N-lsu2GRmY7Ga1s Sep 23 15:33:05.045764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:33:05.045764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:33:05.045764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:33:05.045764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:33:05.045764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:33:05.045764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:33:05.045764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:33:05.045764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:33:05.045764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:33:05.045764 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:33:05.047445 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_695b6a2a390b481bbca2fd367273c268", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}] Sep 23 15:33:05.047445 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:33:05.047445 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:33:05.047445 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:33:05.047445 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:33:05.047445 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:33:05.047445 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:33:05.047445 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 97e06913feae4c23a9abbcd508f818d3 Sep 23 15:33:05.047445 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:33:05.047445 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:33:05.047445 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 could not be found. Sep 23 15:33:05.047445 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0'} Sep 23 15:33:05.048301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:33:05.048301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:05.048301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:33:05.048301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:33:05.048301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:33:05.048301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:33:05.048301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:33:05.048301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:33:05.048301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:33:05.048301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:33:05.048301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 could not be found. Sep 23 15:33:05.048301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:05.048301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:33:05.048301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:05.048301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:05.048301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:33:05.048301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:33:05.048301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:33:05.048301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:33:05.048301 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:33:05.049729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:33:05.049729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 15:33:05.049729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 15:33:05.049729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 15:33:05.049729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 15:33:05.049729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:33:05.049729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:33:05.049729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:33:05.049729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:33:05.049729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 could not be found. Sep 23 15:33:05.049729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:05.049729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:33:05.049729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:05.049729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:05.049729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:33:05.049729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:33:05.049729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:33:05.049729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:33:05.049729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 could not be found. Sep 23 15:33:05.049729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:05.051011 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-63c4a0f7-406b-45a4-9a22-eceb6167cdd7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Returning 404 to user: Instance 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:33:05.051011 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-63c4a0f7-406b-45a4-9a22-eceb6167cdd7 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "DELETE /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0" status: 404 len: 111 microversion: 2.1 time: 0.031268 Sep 23 15:33:05.051011 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 603/1101] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Sep 23 15:33:05 2022] DELETE /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 15:33:05.052105 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b2ad6f98-973e-4f5f-9208-7450d241af75 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:05.052716 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-b2ad6f98-973e-4f5f-9208-7450d241af75 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] [instance: 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:05.058482 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b2ad6f98-973e-4f5f-9208-7450d241af75 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:05.058953 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b2ad6f98-973e-4f5f-9208-7450d241af75 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:05.059384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b2ad6f98-973e-4f5f-9208-7450d241af75 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:05.060100 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b2ad6f98-973e-4f5f-9208-7450d241af75 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:05.060562 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b2ad6f98-973e-4f5f-9208-7450d241af75 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:05.060986 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-b2ad6f98-973e-4f5f-9208-7450d241af75 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:05.075999 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-b2ad6f98-973e-4f5f-9208-7450d241af75 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] HTTP exception thrown: Instance 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 could not be found. Sep 23 15:33:05.077466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b2ad6f98-973e-4f5f-9208-7450d241af75 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Request method failure captured: Sep 23 15:33:05.077466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 HTTP/1.1 Sep 23 15:33:05.077466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:33:05.077466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:33:05.077466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:33:05.077466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:33:05.077466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:33:05.077466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:33:05.077466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:33:05.077466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:33:05.077466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLdCTXikAD57uZ4i3dSe4iywplg8jFFMGgew7gycP2RSgABkVXdIS1SCcQ0LMjtLpKwvlt669y2zWqhAdPefTh5DX__kK-BecMgkhXY17Yr2p9sKhzOx1ndN07Dq20ojAbxl7nPAtGJYV9vyJrlv0NpmeOM7YjuB8N-lsu2GRmY7Ga1s Sep 23 15:33:05.077466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:33:05.077466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:33:05.077466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:33:05.077466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:33:05.077466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:33:05.077466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:33:05.077466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:33:05.077466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:33:05.077466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:33:05.077466 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:33:05.079103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_695b6a2a390b481bbca2fd367273c268", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/695b6a2a390b481bbca2fd367273c268"}]}] Sep 23 15:33:05.079103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:33:05.079103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: 695b6a2a390b481bbca2fd367273c268 Sep 23 15:33:05.079103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878745631 Sep 23 15:33:05.079103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:33:05.079103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:33:05.079103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:33:05.079103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: 97e06913feae4c23a9abbcd508f818d3 Sep 23 15:33:05.079103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-AttachVolumeNegativeTest-1878745631-project Sep 23 15:33:05.079103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:33:05.079103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 could not be found. Sep 23 15:33:05.079103 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': '1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0'} Sep 23 15:33:05.080000 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:33:05.080000 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:05.080000 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:33:05.080000 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:33:05.080000 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:33:05.080000 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:33:05.080000 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:33:05.080000 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:33:05.080000 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:33:05.080000 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:33:05.080000 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 could not be found. Sep 23 15:33:05.080000 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:05.080000 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:33:05.080000 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:05.080000 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:05.080000 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:33:05.080000 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:33:05.080000 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:33:05.080000 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:33:05.080000 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:33:05.081644 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:33:05.081644 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:33:05.081644 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:33:05.081644 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:33:05.081644 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:33:05.081644 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:33:05.081644 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:33:05.081644 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 could not be found. Sep 23 15:33:05.081644 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:05.081644 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:33:05.081644 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:05.081644 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:05.081644 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:33:05.081644 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:33:05.081644 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:33:05.081644 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:33:05.081644 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 could not be found. Sep 23 15:33:05.081644 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:33:05.083012 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-b2ad6f98-973e-4f5f-9208-7450d241af75 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] Returning 404 to user: Instance 1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:33:05.083012 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-b2ad6f98-973e-4f5f-9208-7450d241af75 tempest-AttachVolumeNegativeTest-1878745631 tempest-AttachVolumeNegativeTest-1878745631-project] 10.222.0.55 "GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0" status: 404 len: 111 microversion: 2.1 time: 0.030256 Sep 23 15:33:05.083012 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 604/1102] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:05 2022] GET /compute/v2.1/servers/1c3224bd-5b6c-4c38-bf7b-380a9cc50ac0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 15:33:32.050789 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 15:33:32.051433 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Fri Sep 23 15:33:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.55) !!! Sep 23 15:34:24.626191 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:24.627573 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 15:34:24.627719 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Fri Sep 23 15:34:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.55) !!! Sep 23 15:34:24.632667 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-581d94d1-7df3-442e-82af-969318419d7f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1412953218", "imageRef": "051c4746-7f50-4edb-b09d-a8935df360de", "flavorRef": "452"}} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:34:24.685996 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.network.neutron [None req-581d94d1-7df3-442e-82af-969318419d7f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] validate_networks() for None {{(pid=121450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:34:24.966465 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-581d94d1-7df3-442e-82af-969318419d7f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Flavor limits 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:34:24.966893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-581d94d1-7df3-442e-82af-969318419d7f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Image limits 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:34:24.967370 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-581d94d1-7df3-442e-82af-969318419d7f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Flavor pref 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:34:24.967780 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-581d94d1-7df3-442e-82af-969318419d7f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Image pref 0:0:0 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:34:24.968303 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.virt.hardware [None req-581d94d1-7df3-442e-82af-969318419d7f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:34:24.977418 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-581d94d1-7df3-442e-82af-969318419d7f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:24.977905 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-581d94d1-7df3-442e-82af-969318419d7f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:24.978341 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-581d94d1-7df3-442e-82af-969318419d7f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:24.979136 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-581d94d1-7df3-442e-82af-969318419d7f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:24.979597 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-581d94d1-7df3-442e-82af-969318419d7f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:24.980094 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-581d94d1-7df3-442e-82af-969318419d7f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:24.998170 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-581d94d1-7df3-442e-82af-969318419d7f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Getting quotas for project e350c92d9bb44abe998c6f28c20a6356. Resources: {'ram', 'instances', 'cores'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:34:25.002701 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.quota [None req-581d94d1-7df3-442e-82af-969318419d7f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Getting quotas for user e46d3e40d2cd4653a0b997845dccbeff and project e350c92d9bb44abe998c6f28c20a6356. Resources: {'ram', 'instances', 'cores'} {{(pid=121450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:34:25.015965 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-581d94d1-7df3-442e-82af-969318419d7f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Going to run 1 instances... {{(pid=121450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:34:25.018377 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-581d94d1-7df3-442e-82af-969318419d7f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] [instance: fddacdab-a537-4f14-9cf6-c98868b67183] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='051c4746-7f50-4edb-b09d-a8935df360de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:34:25.185051 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-581d94d1-7df3-442e-82af-969318419d7f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560817 Sep 23 15:34:25.185686 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 605/1103] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Sep 23 15:34:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 15:34:25.197392 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-07ea83c5-9bd2-4a16-a3cc-3a9cad51fff6 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:34:25.201975 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-07ea83c5-9bd2-4a16-a3cc-3a9cad51fff6 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] [instance: fddacdab-a537-4f14-9cf6-c98868b67183] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:34:25.251499 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-07ea83c5-9bd2-4a16-a3cc-3a9cad51fff6 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46d3e40d2cd4653a0b997845dccbeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350c92d9bb44abe998c6f28c20a6356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:34:25.259996 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-07ea83c5-9bd2-4a16-a3cc-3a9cad51fff6 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] 10.222.0.55 "GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183" status: 200 len: 1215 microversion: 2.1 time: 0.066290 Sep 23 15:34:25.260579 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 606/1104] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:34:25 2022] GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183 => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:34:26.282223 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-20a27c7a-e9ca-450e-8b4a-ed1a9c4594b8 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:34:26.282899 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-20a27c7a-e9ca-450e-8b4a-ed1a9c4594b8 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] [instance: fddacdab-a537-4f14-9cf6-c98868b67183] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:34:26.289747 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-20a27c7a-e9ca-450e-8b4a-ed1a9c4594b8 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:26.290230 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-20a27c7a-e9ca-450e-8b4a-ed1a9c4594b8 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:26.290661 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-20a27c7a-e9ca-450e-8b4a-ed1a9c4594b8 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:26.291346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-20a27c7a-e9ca-450e-8b4a-ed1a9c4594b8 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:26.291809 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-20a27c7a-e9ca-450e-8b4a-ed1a9c4594b8 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:26.292241 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-20a27c7a-e9ca-450e-8b4a-ed1a9c4594b8 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:26.357858 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-20a27c7a-e9ca-450e-8b4a-ed1a9c4594b8 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46d3e40d2cd4653a0b997845dccbeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350c92d9bb44abe998c6f28c20a6356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:34:26.366245 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-20a27c7a-e9ca-450e-8b4a-ed1a9c4594b8 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] 10.222.0.55 "GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183" status: 200 len: 1219 microversion: 2.1 time: 0.087964 Sep 23 15:34:26.366812 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 607/1105] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:34:26 2022] GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:34:27.390776 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-8116522c-8383-428c-ae76-820d37e4ae09 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:34:27.392188 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-8116522c-8383-428c-ae76-820d37e4ae09 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] [instance: fddacdab-a537-4f14-9cf6-c98868b67183] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:34:27.400813 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8116522c-8383-428c-ae76-820d37e4ae09 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:27.401332 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8116522c-8383-428c-ae76-820d37e4ae09 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:27.401782 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8116522c-8383-428c-ae76-820d37e4ae09 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:27.402529 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8116522c-8383-428c-ae76-820d37e4ae09 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:27.403155 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8116522c-8383-428c-ae76-820d37e4ae09 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:27.403750 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8116522c-8383-428c-ae76-820d37e4ae09 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:27.476912 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-8116522c-8383-428c-ae76-820d37e4ae09 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46d3e40d2cd4653a0b997845dccbeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350c92d9bb44abe998c6f28c20a6356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:34:27.483880 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-8116522c-8383-428c-ae76-820d37e4ae09 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] 10.222.0.55 "GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183" status: 200 len: 1275 microversion: 2.1 time: 0.097692 Sep 23 15:34:27.484557 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 608/1106] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:34:27 2022] GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183 => generated 1275 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:34:28.510220 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-917cc637-c83c-47da-b9aa-3d3d16c45395 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:34:28.511800 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-917cc637-c83c-47da-b9aa-3d3d16c45395 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] [instance: fddacdab-a537-4f14-9cf6-c98868b67183] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:34:28.518391 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-917cc637-c83c-47da-b9aa-3d3d16c45395 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:28.521592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-917cc637-c83c-47da-b9aa-3d3d16c45395 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:28.521592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-917cc637-c83c-47da-b9aa-3d3d16c45395 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:28.521592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-917cc637-c83c-47da-b9aa-3d3d16c45395 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:28.521592 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-917cc637-c83c-47da-b9aa-3d3d16c45395 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:28.522131 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-917cc637-c83c-47da-b9aa-3d3d16c45395 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:28.733658 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-917cc637-c83c-47da-b9aa-3d3d16c45395 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46d3e40d2cd4653a0b997845dccbeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350c92d9bb44abe998c6f28c20a6356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:34:28.743612 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-917cc637-c83c-47da-b9aa-3d3d16c45395 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] 10.222.0.55 "GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183" status: 200 len: 1315 microversion: 2.1 time: 0.237719 Sep 23 15:34:28.744296 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 609/1107] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:34:28 2022] GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:34:29.213083 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-0048aa3a-87a8-48c5-9d05-f4da45cbc998 req-1d581302-63b6-43e6-bb3e-aee948467f55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fddacdab-a537-4f14-9cf6-c98868b67183", "tag": "9ad37411-4698-4603-8686-9acc0482b1e8"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:34:29.222540 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-0048aa3a-87a8-48c5-9d05-f4da45cbc998 req-1d581302-63b6-43e6-bb3e-aee948467f55 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:29.223008 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-0048aa3a-87a8-48c5-9d05-f4da45cbc998 req-1d581302-63b6-43e6-bb3e-aee948467f55 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:29.223428 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-0048aa3a-87a8-48c5-9d05-f4da45cbc998 req-1d581302-63b6-43e6-bb3e-aee948467f55 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:29.236613 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-0048aa3a-87a8-48c5-9d05-f4da45cbc998 req-1d581302-63b6-43e6-bb3e-aee948467f55 service nova] Creating event network-changed:9ad37411-4698-4603-8686-9acc0482b1e8 for instance fddacdab-a537-4f14-9cf6-c98868b67183 on hv-cinder-85530 Sep 23 15:34:29.241630 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-0048aa3a-87a8-48c5-9d05-f4da45cbc998 req-1d581302-63b6-43e6-bb3e-aee948467f55 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032933 Sep 23 15:34:29.242124 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 610/1108] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:34:29.767836 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-2f9894cf-b1ec-444b-80ef-0196e1528588 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:34:29.768749 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-2f9894cf-b1ec-444b-80ef-0196e1528588 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] [instance: fddacdab-a537-4f14-9cf6-c98868b67183] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:34:29.775095 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2f9894cf-b1ec-444b-80ef-0196e1528588 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:29.775578 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2f9894cf-b1ec-444b-80ef-0196e1528588 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:29.776743 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2f9894cf-b1ec-444b-80ef-0196e1528588 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:29.776743 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2f9894cf-b1ec-444b-80ef-0196e1528588 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:29.777196 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2f9894cf-b1ec-444b-80ef-0196e1528588 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:29.777622 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-2f9894cf-b1ec-444b-80ef-0196e1528588 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:29.943964 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-2f9894cf-b1ec-444b-80ef-0196e1528588 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46d3e40d2cd4653a0b997845dccbeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350c92d9bb44abe998c6f28c20a6356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:34:29.952365 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-2f9894cf-b1ec-444b-80ef-0196e1528588 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] 10.222.0.55 "GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183" status: 200 len: 1315 microversion: 2.1 time: 0.189245 Sep 23 15:34:29.952942 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 611/1109] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:34:29 2022] GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:34:30.977524 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-886612a4-c3bc-44a5-a02d-5e4513740e8d tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:34:30.978252 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-886612a4-c3bc-44a5-a02d-5e4513740e8d tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] [instance: fddacdab-a537-4f14-9cf6-c98868b67183] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:34:30.985133 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-886612a4-c3bc-44a5-a02d-5e4513740e8d tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:30.985628 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-886612a4-c3bc-44a5-a02d-5e4513740e8d tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:30.986327 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-886612a4-c3bc-44a5-a02d-5e4513740e8d tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:30.987039 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-886612a4-c3bc-44a5-a02d-5e4513740e8d tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:30.987497 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-886612a4-c3bc-44a5-a02d-5e4513740e8d tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:30.987924 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-886612a4-c3bc-44a5-a02d-5e4513740e8d tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:31.124210 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-886612a4-c3bc-44a5-a02d-5e4513740e8d tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46d3e40d2cd4653a0b997845dccbeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350c92d9bb44abe998c6f28c20a6356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:34:31.132073 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-886612a4-c3bc-44a5-a02d-5e4513740e8d tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] 10.222.0.55 "GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183" status: 200 len: 1315 microversion: 2.1 time: 0.160385 Sep 23 15:34:31.132627 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 612/1110] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:34:30 2022] GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:34:32.154281 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-16adb259-6413-441c-91b2-4924d4eee958 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:34:32.154986 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-16adb259-6413-441c-91b2-4924d4eee958 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] [instance: fddacdab-a537-4f14-9cf6-c98868b67183] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:34:32.161289 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-16adb259-6413-441c-91b2-4924d4eee958 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:32.161758 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-16adb259-6413-441c-91b2-4924d4eee958 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:32.162186 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-16adb259-6413-441c-91b2-4924d4eee958 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:32.163393 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-16adb259-6413-441c-91b2-4924d4eee958 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:32.163941 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-16adb259-6413-441c-91b2-4924d4eee958 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:32.164384 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-16adb259-6413-441c-91b2-4924d4eee958 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:32.295224 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-16adb259-6413-441c-91b2-4924d4eee958 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46d3e40d2cd4653a0b997845dccbeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350c92d9bb44abe998c6f28c20a6356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:34:32.302891 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-16adb259-6413-441c-91b2-4924d4eee958 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] 10.222.0.55 "GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183" status: 200 len: 1315 microversion: 2.1 time: 0.152481 Sep 23 15:34:32.304020 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 613/1111] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:34:32 2022] GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:34:33.327253 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-45c12376-b9b8-45b2-8027-067af548ba92 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:34:33.327930 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-45c12376-b9b8-45b2-8027-067af548ba92 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] [instance: fddacdab-a537-4f14-9cf6-c98868b67183] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:34:33.334284 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-45c12376-b9b8-45b2-8027-067af548ba92 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:33.334774 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-45c12376-b9b8-45b2-8027-067af548ba92 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:33.335211 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-45c12376-b9b8-45b2-8027-067af548ba92 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:33.335903 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-45c12376-b9b8-45b2-8027-067af548ba92 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:33.336389 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-45c12376-b9b8-45b2-8027-067af548ba92 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:33.336815 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-45c12376-b9b8-45b2-8027-067af548ba92 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:33.468771 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-45c12376-b9b8-45b2-8027-067af548ba92 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46d3e40d2cd4653a0b997845dccbeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350c92d9bb44abe998c6f28c20a6356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:34:33.477976 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-45c12376-b9b8-45b2-8027-067af548ba92 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] 10.222.0.55 "GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183" status: 200 len: 1315 microversion: 2.1 time: 0.154514 Sep 23 15:34:33.478794 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 614/1112] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:34:33 2022] GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:34:34.501207 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-7919a744-b0f7-4b3d-8511-27d0239b91f5 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:34:34.501877 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-7919a744-b0f7-4b3d-8511-27d0239b91f5 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] [instance: fddacdab-a537-4f14-9cf6-c98868b67183] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:34:34.508813 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7919a744-b0f7-4b3d-8511-27d0239b91f5 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:34.509315 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7919a744-b0f7-4b3d-8511-27d0239b91f5 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:34.509760 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7919a744-b0f7-4b3d-8511-27d0239b91f5 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:34.510427 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7919a744-b0f7-4b3d-8511-27d0239b91f5 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:34.510870 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7919a744-b0f7-4b3d-8511-27d0239b91f5 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:34.511288 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-7919a744-b0f7-4b3d-8511-27d0239b91f5 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:34.647478 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-7919a744-b0f7-4b3d-8511-27d0239b91f5 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46d3e40d2cd4653a0b997845dccbeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350c92d9bb44abe998c6f28c20a6356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:34:34.655364 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-7919a744-b0f7-4b3d-8511-27d0239b91f5 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] 10.222.0.55 "GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183" status: 200 len: 1315 microversion: 2.1 time: 0.157938 Sep 23 15:34:34.655929 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 615/1113] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:34:34 2022] GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:34:35.546107 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-a4b2f835-c6f2-4300-bbe5-74feb705c1a0 req-e53d2d0e-9798-4e2c-ac92-9ffca29210b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fddacdab-a537-4f14-9cf6-c98868b67183", "name": "network-vif-plugged", "status": "completed", "tag": "9ad37411-4698-4603-8686-9acc0482b1e8"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:34:35.551194 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell0:SELECT=2 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:35.551892 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell0:SELECT=8 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:35.558228 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-a4b2f835-c6f2-4300-bbe5-74feb705c1a0 req-e53d2d0e-9798-4e2c-ac92-9ffca29210b1 service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:35.558701 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-a4b2f835-c6f2-4300-bbe5-74feb705c1a0 req-e53d2d0e-9798-4e2c-ac92-9ffca29210b1 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:35.559138 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-a4b2f835-c6f2-4300-bbe5-74feb705c1a0 req-e53d2d0e-9798-4e2c-ac92-9ffca29210b1 service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:35.572005 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-a4b2f835-c6f2-4300-bbe5-74feb705c1a0 req-e53d2d0e-9798-4e2c-ac92-9ffca29210b1 service nova] Creating event network-vif-plugged:9ad37411-4698-4603-8686-9acc0482b1e8 for instance fddacdab-a537-4f14-9cf6-c98868b67183 on hv-cinder-85530 Sep 23 15:34:35.576834 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-a4b2f835-c6f2-4300-bbe5-74feb705c1a0 req-e53d2d0e-9798-4e2c-ac92-9ffca29210b1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035175 Sep 23 15:34:35.577426 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 616/1114] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:34:35.680046 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-1c77ffe4-6673-4c48-852e-d9c50d51d22f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:34:35.680758 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-1c77ffe4-6673-4c48-852e-d9c50d51d22f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] [instance: fddacdab-a537-4f14-9cf6-c98868b67183] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:34:35.687079 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1c77ffe4-6673-4c48-852e-d9c50d51d22f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:35.687561 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1c77ffe4-6673-4c48-852e-d9c50d51d22f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:35.688040 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1c77ffe4-6673-4c48-852e-d9c50d51d22f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:35.688729 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1c77ffe4-6673-4c48-852e-d9c50d51d22f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:35.689185 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1c77ffe4-6673-4c48-852e-d9c50d51d22f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:35.689613 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-1c77ffe4-6673-4c48-852e-d9c50d51d22f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:35.868202 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-1c77ffe4-6673-4c48-852e-d9c50d51d22f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46d3e40d2cd4653a0b997845dccbeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350c92d9bb44abe998c6f28c20a6356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:34:35.876311 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-1c77ffe4-6673-4c48-852e-d9c50d51d22f tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] 10.222.0.55 "GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183" status: 200 len: 1315 microversion: 2.1 time: 0.201053 Sep 23 15:34:35.876889 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 617/1115] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:34:35 2022] GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:34:36.900214 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-0483063e-733e-4ea3-a77d-cbe40ee178b3 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:34:36.900915 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-0483063e-733e-4ea3-a77d-cbe40ee178b3 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] [instance: fddacdab-a537-4f14-9cf6-c98868b67183] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:34:36.907510 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0483063e-733e-4ea3-a77d-cbe40ee178b3 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:36.908068 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0483063e-733e-4ea3-a77d-cbe40ee178b3 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:36.908508 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0483063e-733e-4ea3-a77d-cbe40ee178b3 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:36.909218 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0483063e-733e-4ea3-a77d-cbe40ee178b3 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:36.909669 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0483063e-733e-4ea3-a77d-cbe40ee178b3 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:36.910206 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-0483063e-733e-4ea3-a77d-cbe40ee178b3 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:37.042750 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-0483063e-733e-4ea3-a77d-cbe40ee178b3 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46d3e40d2cd4653a0b997845dccbeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350c92d9bb44abe998c6f28c20a6356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:34:37.050463 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-0483063e-733e-4ea3-a77d-cbe40ee178b3 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] 10.222.0.55 "GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183" status: 200 len: 1315 microversion: 2.1 time: 0.155391 Sep 23 15:34:37.051088 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 618/1116] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:34:36 2022] GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:34:38.074127 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-9f87b36a-5548-4046-8992-52413c1e13b6 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:34:38.074839 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-9f87b36a-5548-4046-8992-52413c1e13b6 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] [instance: fddacdab-a537-4f14-9cf6-c98868b67183] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:34:38.081712 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9f87b36a-5548-4046-8992-52413c1e13b6 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:38.082597 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9f87b36a-5548-4046-8992-52413c1e13b6 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:38.082706 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9f87b36a-5548-4046-8992-52413c1e13b6 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:38.083369 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9f87b36a-5548-4046-8992-52413c1e13b6 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:38.083824 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9f87b36a-5548-4046-8992-52413c1e13b6 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:38.084614 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-9f87b36a-5548-4046-8992-52413c1e13b6 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:38.223307 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-9f87b36a-5548-4046-8992-52413c1e13b6 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46d3e40d2cd4653a0b997845dccbeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350c92d9bb44abe998c6f28c20a6356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:34:38.232168 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-9f87b36a-5548-4046-8992-52413c1e13b6 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] 10.222.0.55 "GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183" status: 200 len: 1464 microversion: 2.1 time: 0.162106 Sep 23 15:34:38.232751 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 619/1117] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:34:38 2022] GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183 => generated 1464 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:34:38.279884 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-307bd5ae-0ec0-4537-a634-f96271b97e53 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:34:38.280440 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-307bd5ae-0ec0-4537-a634-f96271b97e53 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] [instance: fddacdab-a537-4f14-9cf6-c98868b67183] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:34:38.286407 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-307bd5ae-0ec0-4537-a634-f96271b97e53 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:38.286889 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-307bd5ae-0ec0-4537-a634-f96271b97e53 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:38.287850 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-307bd5ae-0ec0-4537-a634-f96271b97e53 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:38.288571 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-307bd5ae-0ec0-4537-a634-f96271b97e53 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:38.289019 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-307bd5ae-0ec0-4537-a634-f96271b97e53 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:38.289437 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-307bd5ae-0ec0-4537-a634-f96271b97e53 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:38.315329 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-307bd5ae-0ec0-4537-a634-f96271b97e53 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] [instance: fddacdab-a537-4f14-9cf6-c98868b67183] Going to try to terminate instance {{(pid=121450) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:34:38.565280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-307bd5ae-0ec0-4537-a634-f96271b97e53 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] 10.222.0.55 "DELETE /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183" status: 204 len: 0 microversion: 2.1 time: 0.288900 Sep 23 15:34:38.565882 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 620/1118] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Sep 23 15:34:38 2022] DELETE /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 15:34:38.574698 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-3c29fc50-0c12-4c37-8bbc-7aabb9ff5f2a tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:34:38.580948 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-3c29fc50-0c12-4c37-8bbc-7aabb9ff5f2a tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] [instance: fddacdab-a537-4f14-9cf6-c98868b67183] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:34:38.582323 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3c29fc50-0c12-4c37-8bbc-7aabb9ff5f2a tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:38.582826 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3c29fc50-0c12-4c37-8bbc-7aabb9ff5f2a tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:38.583616 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3c29fc50-0c12-4c37-8bbc-7aabb9ff5f2a tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:38.585112 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3c29fc50-0c12-4c37-8bbc-7aabb9ff5f2a tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:38.585724 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3c29fc50-0c12-4c37-8bbc-7aabb9ff5f2a tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:38.586156 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3c29fc50-0c12-4c37-8bbc-7aabb9ff5f2a tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:38.719839 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-3c29fc50-0c12-4c37-8bbc-7aabb9ff5f2a tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46d3e40d2cd4653a0b997845dccbeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350c92d9bb44abe998c6f28c20a6356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:34:38.728641 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-3c29fc50-0c12-4c37-8bbc-7aabb9ff5f2a tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] 10.222.0.55 "GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183" status: 200 len: 1470 microversion: 2.1 time: 0.157989 Sep 23 15:34:38.729211 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 621/1119] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:34:38 2022] GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:34:39.754697 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-3cfb6106-f6f3-4375-9313-6d51acc93dc7 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:34:39.755389 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-3cfb6106-f6f3-4375-9313-6d51acc93dc7 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] [instance: fddacdab-a537-4f14-9cf6-c98868b67183] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:34:39.761828 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3cfb6106-f6f3-4375-9313-6d51acc93dc7 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:39.762297 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3cfb6106-f6f3-4375-9313-6d51acc93dc7 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:39.762725 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3cfb6106-f6f3-4375-9313-6d51acc93dc7 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:39.763468 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3cfb6106-f6f3-4375-9313-6d51acc93dc7 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:39.763915 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3cfb6106-f6f3-4375-9313-6d51acc93dc7 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:39.764373 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-3cfb6106-f6f3-4375-9313-6d51acc93dc7 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:39.782192 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG dbcounter [-] [121450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:39.934634 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-3cfb6106-f6f3-4375-9313-6d51acc93dc7 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46d3e40d2cd4653a0b997845dccbeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350c92d9bb44abe998c6f28c20a6356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:34:39.942426 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-3cfb6106-f6f3-4375-9313-6d51acc93dc7 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] 10.222.0.55 "GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183" status: 200 len: 1470 microversion: 2.1 time: 0.191574 Sep 23 15:34:39.943004 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 622/1120] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:34:39 2022] GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183 => generated 1470 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:34:40.718928 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [req-e7575b75-7e19-4f79-8019-236d16e504c7 req-759c0ee9-3ae5-40e7-a4eb-25c970d9256f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fddacdab-a537-4f14-9cf6-c98868b67183", "name": "network-vif-deleted", "tag": "9ad37411-4698-4603-8686-9acc0482b1e8"}]} {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:34:40.730139 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-e7575b75-7e19-4f79-8019-236d16e504c7 req-759c0ee9-3ae5-40e7-a4eb-25c970d9256f service nova] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:40.730690 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-e7575b75-7e19-4f79-8019-236d16e504c7 req-759c0ee9-3ae5-40e7-a4eb-25c970d9256f service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:40.733934 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [req-e7575b75-7e19-4f79-8019-236d16e504c7 req-759c0ee9-3ae5-40e7-a4eb-25c970d9256f service nova] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:40.744410 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.compute.server_external_events [req-e7575b75-7e19-4f79-8019-236d16e504c7 req-759c0ee9-3ae5-40e7-a4eb-25c970d9256f service nova] Creating event network-vif-deleted:9ad37411-4698-4603-8686-9acc0482b1e8 for instance fddacdab-a537-4f14-9cf6-c98868b67183 on hv-cinder-85530 Sep 23 15:34:40.749847 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [req-e7575b75-7e19-4f79-8019-236d16e504c7 req-759c0ee9-3ae5-40e7-a4eb-25c970d9256f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034945 Sep 23 15:34:40.750550 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 623/1121] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Sep 23 15:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:34:40.967342 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-8aba0e3e-596c-44fe-9eaf-0429026b91e9 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:34:40.968001 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-8aba0e3e-596c-44fe-9eaf-0429026b91e9 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] [instance: fddacdab-a537-4f14-9cf6-c98868b67183] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:34:40.974166 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8aba0e3e-596c-44fe-9eaf-0429026b91e9 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:40.974649 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8aba0e3e-596c-44fe-9eaf-0429026b91e9 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:40.975636 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8aba0e3e-596c-44fe-9eaf-0429026b91e9 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:40.976346 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8aba0e3e-596c-44fe-9eaf-0429026b91e9 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:40.976798 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8aba0e3e-596c-44fe-9eaf-0429026b91e9 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:40.977226 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8aba0e3e-596c-44fe-9eaf-0429026b91e9 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:41.009851 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8aba0e3e-596c-44fe-9eaf-0429026b91e9 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:41.010320 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8aba0e3e-596c-44fe-9eaf-0429026b91e9 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:41.010756 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-8aba0e3e-596c-44fe-9eaf-0429026b91e9 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:41.011198 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.objects.instance [None req-8aba0e3e-596c-44fe-9eaf-0429026b91e9 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lazy-loading 'fault' on Instance uuid fddacdab-a537-4f14-9cf6-c98868b67183 {{(pid=121450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:34:41.052377 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.policy [None req-8aba0e3e-596c-44fe-9eaf-0429026b91e9 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46d3e40d2cd4653a0b997845dccbeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350c92d9bb44abe998c6f28c20a6356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121450) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:34:41.060893 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-8aba0e3e-596c-44fe-9eaf-0429026b91e9 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] 10.222.0.55 "GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183" status: 200 len: 1305 microversion: 2.1 time: 0.098426 Sep 23 15:34:41.061472 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 624/1122] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:34:40 2022] GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183 => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:34:42.084535 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-e81cd643-a2c4-4639-a846-c05e8dbc2e17 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Calling method '>' {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:34:42.085147 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.compute.api [None req-e81cd643-a2c4-4639-a846-c05e8dbc2e17 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] [instance: fddacdab-a537-4f14-9cf6-c98868b67183] Fetching instance by UUID {{(pid=121450) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:34:42.092380 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e81cd643-a2c4-4639-a846-c05e8dbc2e17 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:42.092869 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e81cd643-a2c4-4639-a846-c05e8dbc2e17 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:42.093309 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e81cd643-a2c4-4639-a846-c05e8dbc2e17 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:42.094004 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e81cd643-a2c4-4639-a846-c05e8dbc2e17 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Acquiring lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:42.094462 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e81cd643-a2c4-4639-a846-c05e8dbc2e17 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:42.094891 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG oslo_concurrency.lockutils [None req-e81cd643-a2c4-4639-a846-c05e8dbc2e17 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Lock "4716d4cc-8887-47c1-8c33-3edcb99d9da0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:42.108657 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.wsgi [None req-e81cd643-a2c4-4639-a846-c05e8dbc2e17 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] HTTP exception thrown: Instance fddacdab-a537-4f14-9cf6-c98868b67183 could not be found. Sep 23 15:34:42.110280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-e81cd643-a2c4-4639-a846-c05e8dbc2e17 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Request method failure captured: Sep 23 15:34:42.110280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: request: GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183 HTTP/1.1 Sep 23 15:34:42.110280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept: application/json Sep 23 15:34:42.110280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Accept-Encoding: identity Sep 23 15:34:42.110280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Connection: close Sep 23 15:34:42.110280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Length: 0 Sep 23 15:34:42.110280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Content-Type: application/json Sep 23 15:34:42.110280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Host: 10.222.0.55 Sep 23 15:34:42.110280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: Openstack-System-Scope: None Sep 23 15:34:42.110280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: User-Agent: python-urllib3/1.26.12 Sep 23 15:34:42.110280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Auth-Token: gAAAAABjLdH-XAglZ_YvR1o8Mnujjut1ydODMS2vK0eoa8zj-kiCiGKNRtIzJQ5skJvTvTQpWIW6z3EqE5oHeAgYen9a42xwy0Qn3eB1dkgy6Vei3twsMqFuuPQlzZv34su8ZbRSj9goMl5iYq9pev5OJGCrBhrzyglG5LTWFU6OjPiTrkPKl1U Sep 23 15:34:42.110280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Id: None Sep 23 15:34:42.110280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Domain-Name: None Sep 23 15:34:42.110280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Identity-Status: Confirmed Sep 23 15:34:42.110280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Is-Admin-Project: True Sep 23 15:34:42.110280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Id: default Sep 23 15:34:42.110280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Domain-Name: Default Sep 23 15:34:42.110280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Id: e350c92d9bb44abe998c6f28c20a6356 Sep 23 15:34:42.110280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Project-Name: tempest-VolumesNegativeTest-1288329743 Sep 23 15:34:42.110280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Role: reader,member Sep 23 15:34:42.110280 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Roles: reader,member Sep 23 15:34:42.112371 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e350c92d9bb44abe998c6f28c20a6356"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e350c92d9bb44abe998c6f28c20a6356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e350c92d9bb44abe998c6f28c20a6356", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e350c92d9bb44abe998c6f28c20a6356"}]}] Sep 23 15:34:42.112371 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant: tempest-VolumesNegativeTest-1288329743 Sep 23 15:34:42.112371 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Id: e350c92d9bb44abe998c6f28c20a6356 Sep 23 15:34:42.112371 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-Tenant-Name: tempest-VolumesNegativeTest-1288329743 Sep 23 15:34:42.112371 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User: tempest-VolumesNegativeTest-1288329743-project Sep 23 15:34:42.112371 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Id: default Sep 23 15:34:42.112371 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Domain-Name: Default Sep 23 15:34:42.112371 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Id: e46d3e40d2cd4653a0b997845dccbeff Sep 23 15:34:42.112371 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: X-User-Name: tempest-VolumesNegativeTest-1288329743-project Sep 23 15:34:42.112371 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: method: > Sep 23 15:34:42.112371 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: exception: Instance fddacdab-a537-4f14-9cf6-c98868b67183 could not be found. Sep 23 15:34:42.112371 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: action_args: {'id': 'fddacdab-a537-4f14-9cf6-c98868b67183'} Sep 23 15:34:42.113723 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: {{(pid=121450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:34:42.113723 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:34:42.113723 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:34:42.113723 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:34:42.113723 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:34:42.113723 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:34:42.113723 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:34:42.113723 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:34:42.113723 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:34:42.113723 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:34:42.113723 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fddacdab-a537-4f14-9cf6-c98868b67183 could not be found. Sep 23 15:34:42.113723 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:34:42.113723 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:34:42.113723 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:34:42.113723 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:34:42.113723 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:34:42.113723 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:34:42.113723 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:34:42.113723 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:34:42.113723 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:34:42.115409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:34:42.115409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:34:42.115409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:34:42.115409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:34:42.115409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:34:42.115409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:34:42.115409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:34:42.115409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fddacdab-a537-4f14-9cf6-c98868b67183 could not be found. Sep 23 15:34:42.115409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:34:42.115409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:34:42.115409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:34:42.115409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:34:42.115409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:34:42.115409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:34:42.115409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:34:42.115409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:34:42.115409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fddacdab-a537-4f14-9cf6-c98868b67183 could not be found. Sep 23 15:34:42.115409 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: ERROR nova.api.openstack.wsgi Sep 23 15:34:42.117171 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: DEBUG nova.api.openstack.wsgi [None req-e81cd643-a2c4-4639-a846-c05e8dbc2e17 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] Returning 404 to user: Instance fddacdab-a537-4f14-9cf6-c98868b67183 could not be found. {{(pid=121450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:34:42.117171 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: INFO nova.api.openstack.requestlog [None req-e81cd643-a2c4-4639-a846-c05e8dbc2e17 tempest-VolumesNegativeTest-1288329743 tempest-VolumesNegativeTest-1288329743-project] 10.222.0.55 "GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183" status: 404 len: 111 microversion: 2.1 time: 0.031262 Sep 23 15:34:42.117171 dv-cinder-855307-2-iscsi devstack@n-api.service[121450]: [pid: 121450|app: 0|req: 625/1123] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Sep 23 15:34:42 2022] GET /compute/v2.1/servers/fddacdab-a537-4f14-9cf6-c98868b67183 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 15:35:23.908169 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 15:35:23.908797 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Fri Sep 23 15:35:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.55) !!! Sep 23 15:35:42.164884 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 15:35:42.165568 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Fri Sep 23 15:35:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.55) !!! Sep 23 15:36:52.062053 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 15:36:52.062740 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Fri Sep 23 15:36:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.55) !!! Sep 23 15:38:43.919112 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 15:38:43.919112 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Fri Sep 23 15:38:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.55) !!! Sep 23 15:39:02.175992 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 15:39:02.176805 dv-cinder-855307-2-iscsi devstack@n-api.service[121448]: Fri Sep 23 15:39:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.55) !!!